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Description 

This invention relates to the automatic recogni- 
tion of broadcast segments, particularly commercial 
advertisements broadcast by television stations. 

Commercial advertisers are interested in log data 
showing when various commercials are broadcast on 
radio or television. This interest stems both from a de- 
sire to confirm that broadcast time paid for was ac- 
tually provided and from an interest in monitoring 
competitors' advertising strategies. 

It would be advantageous to be able to provide an 
automated method and system for logging commer- 
cial broadcast data which does not rely for recognition 
on the insertion of special codes in the broadcast sig- 
nal or on cues occurring in the signal. 

It is also desirable to provide such a method and 
system which can identify large numbers of commer- 
cials in an economic and efficient manner in real time, 
without resorting to expensive parallel processing or 
to the most powerful computers. 

US Patent 3,919,479 describes a technique for 
identifying broadcast segments in which the seg- 
ments are digitised and correlated with a digitised ref- 
erence. When the output of the correlation function 
exceeds a predetermined threshold, a match is found. 

The journal of the SMPTE, Volume 84, March 
1975, pages 162 to 163, New York, U.S.A.; G Auer- 
bach; entitled "A Pattern- Recognition System for 
Monitoring Video and Audio Signals" outlines a pat- 
tern-recognition type of system for recognising spe- 
cial broadcasts, wherein a "library" of commercial 
codes is produced by first obtaining video tapes of 
commercials having known and optimised quality. A 
data set is produced from these commercials by sam- 
pling eight frames at predetermined locations therein, 
and comparing the resulting signatures against 
broadcast signals. 

French Patent 2,559,002 describes a technique 
for detecting the broadcasting of audiovisual informa- 
tion by a radio or television station. The document 
states that a received broadcast is recorded and a 
comparator compares the broadcast with recorded 
signatures contained in a memory. The signatures 
consist of at least a portion of the spectral analysis of 
the information to be detected, and the comparator 
comprises a plurality of processors each of which 
makes the comparison of the recording with at least 
one signature. 

Summary of the Invention 

It is an object of this invention to provide an au- 
tomated method, apparatus and system for logging 
commercial broadcast data which does not rely for 
recognition on the insertion of special codes or on 
cues occurring in the signal. 

It is another object of this invention to provide 



such a method, apparatus and system which can 
identify large numbers of commercials in an efficient 
and economic manner in real time, without resorting 
to expensive parallel processing or to the most pow- 

5 erful computers. 

The present invention provides a method and ap- 
paratus for real-time continuous pattern recognition 
of broadcast segments by constructing a digital sig- 
nature from a known specimen of a segment which is 

10 to be recognized. The signature is constructed by dig- 
itally parametizing the segment, selecting portions 
from among random frame locations throughout the 
segment in accordance with a set of predefined rules 
(i.e. different frames are selected for each segment, 

15 but the selection is always based on the same criteria) 
to form the signature, and associating with the signa- 
ture the frame locations of the portions. The signa- 
ture and associated frame locations are stored in a li- 
brary of signatures. Each signature in the library is 

20 identified with a particular segment to be recognized. 
A broadcast signal is monitored and digitally para me- 
tized. For each frame of the parametized monitored 
signal, the library is searched for any signature that 
may be associated with that frame. Using the frame 

25 information stored with the signature, each of the po- 
tentially associated stored signatures is compared to 
the appropriate frames of the parametized signal. If a 
stored signature compares with the monitored data, 
a match is declared and the broadcast segment is 

30 identified using identification data associated with 
the signature. 

In another embodiment of a method and appara- 
tus according to the invention, a digital keyword de- 
rived from a designated frame in the parametized 

35 segment is identified as associated with the segment 
signature, but the association of that keyword with a 
particular segment signature is non-exclusive — i.e., 
the same keyword can be associated with more than 
one signature. A plurality of additional frames is se- 

40 lected from among random frame locations through- 
out the segment in accordance with a set of prede- 
fined rules and, in a library of signatures, the keyword 
representing the designated frame and the words 
representing the additional frames are stored togeth- 

45 er with the offsets of the additional frames relative to 
the designated frame. A broadcast signal is monitored 
and digitally parametized. For each monitored digital 
word of the parametized monitored signal, the library 
is searched for any signature associated with a key- 
so word corresponding to that monitored word, and the 
additional words of any such signature are compared 
with those words of the parametized monitored signal 
which are separated from the monitored word by the 
stored offset amounts. If the stored signature com- 

55 pares with the monitored data, a match is declared 
and the broadcast segment is identified using identi- 
fication data associated with the signature data. 
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Brief Description of the Drawings 

The above and other objects and advantages of 
the invention will be apparent upon consideration of 
the following detailed description, taken in conjunc- 
tion with the accompanying drawings, in which like 
reference characters refer to like parts throughout, 
and in which: 

FIG. 1 is a diagrammatic representation of the 

areas of a video frame sampled to derive pa ram e- 

tized signal data; 

FIG. 2 is a block diagram of a system according 
to the invention; 

FIG. 3 is a block diagram of an experimental local 
site according to the invention; 
FIG. 4 is a flowchart of a software program used 
in the system of FIG. 3; 

FIG. 5 is a flowchart of a second software pro- 
gram used in the system of FIG. 3; 
FIG. 6 is a flowchart of a third software program 
used in the system of FIG. 3; 
FIG. 7 is a flowchart of a fourth software program 
used in the system of FIG. 3; 
FIG. 8 is a block diagram of a local site according 
to the invention; 

FIG. 9 is a block diagram of the signal processing 
subsystem of FIG. 8; r . 
FIG. 10 is a block diagram of the correlator card 
of FIG. 9; • 

FIG. 11 A is a block diagram of the audio capture 
card of FIG. 9; 

FIG. 11 B is a block diagram of the video capture 
card of FIG. 9; and 

FIG. 12 is a block diagram of the central site and 
system communications of the invention. 

Detailed Description of the Invention 

I. Theory of Preferred Operation 

The present invention can identify a segment of 
a broadcast signal by pure continuous pattern recog- 
nition on a real-time basis. No codes need be inserted 
into the broadcast signal prior to transmission and no 
"cues" or "signalling events" (e.g., fades-to-black or 
scene changes) that occur in the broadcast need be 
used in the recognition process. The broadcast signal 
can be either a radio broadcast, for which audio infor- 
mation is obviously used for the recognition process, 
or a television broadcast, for which audio information, 
video information, or both, can be used, and can be 
an over-the-air signal, a cable television signal, or a 
videotape signal. 

Whether audio or video information is used, the 
broadcast signal is parametized to yield a digital data 
stream composed, preferably, of one 16-bit digital 
word for every 1/30 of a second of signal. (In the case 
of audio information associated with video inform a- 



18 533 B1 4 

tion, the audio data is synchronized with the video 
frame rate to form an "audio frame".) The information 
is then processed in the same way whether it origin- 
ated as audio or video. 

5 A digital signature is constructed for each seg- 

ment to be recognized. The construction of the signa- 
ture is discussed in more detail below. However, it 
preferably comprises 128 bits representing eight 16- 
bit words corresponding to eight frames of signal in- 
to formation selected from among random frame loca- 
tions throughout the segment in accordance with a 
set of predefined rules. 

The incoming audio or video signal is digitized 
and parametized to yield, preferably, a 16-bit digital 

15 word for each frame of data. This also is discussed in 
more detail below. As the incoming signal is received, 
it is read into a buffer which holds, e.g., two minutes 
of signal data. Each word of this data is assumed to 
be the first word of an eight-word signature. Assoc i- 

20 ated with each word of the signature is offset informa- 
tion indicating the spacing (i.e., the number of 
frames) between each such word and the first signa- 
ture word. As each received word reaches a predeter- 
mined observation point in the buffer, the library of 

25 signatures of known segments to be recognized is 
searched for signatures beginning with that word. Us- 
ing the offset information stored with the signatures, 
subsequent received words, already in the buffer, are 
compared to the remaining signature words to deter- 

30 mine whether or not they match those remaining 
words of the signature. 

In order for the method to operate in real time, all 
library comparisons must be made in the time that a 
received word remains at the observation point, be- 

35 cause a television frame lasts 1/30 second, all com- 
parisons for a given received word must take place 
within 1/30 second. If every segment signature in the 
library must be compared to the incoming frame sig- 
nature data every 1/30 second, current computer 

40 speeds would allow comparison to only a few thou- 
sand library signatures. This would place an upper 
limit on the number of segments whose signatures 
can be stored in the library and the number of broad- 
cast segments (e.g., commercials) which could be 

45 monitored without using expensive parallel proces- 
sors or very powerful computers. 

In the United States, however, as many as 500 
different commercials may be playing within a market 
region at any given time. Assuming a market having 

50 6 stations to be monitored, in the aggregate there may 
be as many as 4,000 or more occurrences of these 
commercials each day. Moreover, as many as 40,000 
different commercial may be airing nationwide at 
any given time, and as many as 90,000 or more new 

55 commercials may be introduced nationwide each 
year. Accordingly, it is desirable that the system of the 
invention be capable of comparing, in real time, in- 
coming frame signature data to many tens of thou- 
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sands of segment signatures representative of as 
many different commercials. 

The number of signatures that can be stored and 
searched within the real-time limitation of 1/30 sec- 
ond and, hence, the number of broadcast segments 5 
which can be monitored can be increased to several 
hundred thousand using a designated frame keyword 
lookup data reduction method, using such a method, 
when a signature is constructed for a known seg- 
ment, one frame from the segment is chosen, using 10 
criteria to be discussed below, as the key frame, its 
digital parametized equivalent becoming the key- 
word. The signature is still, preferably, eight 16-bit 
words, but the stored offset information now repre- 
sents spacing from the keyword rather than from the 15 
first signature word. The keyword can be one of the 
signature data words, in which case the offset for that 
word is zero, or it can be a ninth word. The keyword 
also need not temporally precede all of the other sig- 
nature words and often will not. If 16-bit words are 20 
used, there can be 2 16 , or 65,536, possible keywords. 
Signatures are thus stored in a lookup table with 
65,536 keys. Each received word that reaches the ob- 
servation point in the buffer is assumed to be a key- 
word. Using the lookup table, a small number of pos- 25 
sible signatures associated with that keyword are 
identified. As discussed below, one of the selection 
criteria for keywords is that on average four signa- 
tures have the same keyword. Typically, then, four 
signature comparisons would be the maximum that 30 
would have to be made within the 1/30 second time 
limit, assuming no data errors in the received signal. 
Four signatures multiplied by 65,536 keys yields 
262,144 possible signatures for the system, meaning 
that the system has the capability of identifying in real 35 
time any of that number of broadcast segments. 

Whether or not the designated frame keyword 
lookup technique is used, the present invention need 
not rely during the recognition process on any cues, 
signalling events or pre-established codes in the 40 
broadcast signal. It simply monitors the incoming sig- 
nal and performs continuous pattern recognition. 

Video information is parametized and digitized as 
described below. Although, in the description which 
follows, parametization is based upon signal lumi- 45 
nance, it is to be understood that other or additional 
attributes of a video signal could be used for this pur- 
pose. 

A number of areas, preferably 16 (although more 
or fewer areas may be used), of the video field or so 
frame are selected. The size of each area is prefer- 
ably eight-by-two pizels, although areas of other si- 
zes could be used. The luminance of each area is 
averaged to produce an absolute gray scale value 
from, e.g., 0-255. This value is normalized to a bit val- 55 
ue of 0 or 1 by cooparing the value to one of the fol- 
lowing: 

1. The average luminance of the entire field or 



frame; 

2. The average luminance of some other area of 
the field or frame; 

3. The average luminance of the same area in 
some previous field or frame; or 

4. The average luminance of some other area of 
some previous field or frame. 

The goal in selecting which comparison to make is to 
maximize entropy — i.e., to minimize correlation be- 
tween the areas. (Correlation refers to the degree to 
which the luminance value of one area is related to or 
follows that of another area.) For this reason, the 
fourth comparison, above, is preferred, with the pre- 
vious frame being one to four frames behind the cur- 
rent frame. For the same reason, the distribution of 
the sixteen areas in the field or frame, as well as the 
sixteen areas in the previous field or frame, is prefer- 
ably asymmetrical about the center of the field or 
frame, because it has been empirically determined 
that video frames are composed in such a way that 
there is too much correlation between symmetrically 
located areas. 

A sample partial distribution of areas within a 
frame is shown in FIG. 1 . Frame 1 0 is actually a video 
field of sampled pixels. (Hereinafter, "frame" will be 
used to mean either field or frame.) The luminance 
areas f n (n = 1-16) (not all sixteen shown) are the 
areas used for determining the parametized digital 
word for the current frame. The luminance areas 2 n ' 
(n = 1-16) (not all sixteen shown) are areas whose val- 
ues are held for use as the "previous frame" data for 
a later frame. 

Whatever comparison is used, a bit value of 1 is 
returned if the luminance of the area in question ex- 
ceeds the luminance of the comparison area. If the lu- 
minance of the area in question is less than or equal 
to the luminance of the comparison area, a bit value 
of 0 is returned. (It is to be understood that here, and 
in the discussion that follows, the assignments of 
ones and zeroes for data and mask values can be re- 
versed.) By normalizing the data in this way, offset 
and gain differences between signals transmitted by 
different stations or at different times (caused, e.g., 
by different transmitter control settings), are mini- 
mized. The sixteen values thus derived create a par- 
ametized "frame signature". 

A 16-bit mask word is created along with each 1 6- 
bit frame signature. The mask word represents the 
reliability of the frame signature. For each bit in the 
frame signature, if the absolute value of the lumi- 
nance difference used to calculate that bit value is 
less than a threshold or "guard band" value, the lumi- 
nance value is assumed to have been susceptible to 
error (because of noise in transmission), and so the 
mask bit for that bit is set to 0, indicating suspect data. 
If the absolute value of the luminance difference is 
greater than or equal to the guard band value, the lu- 
minance value is assumed to be such greater than the 
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noise level and the corresponding mask bit is set to 
1, indicating reliable data. As discussed below, the 
number of ones or zeroes in the mask word is used in 
generating segment signatures and setting compari- 
son thresholds. 

An audio '"frame* signature," if such a signature 
is used, can be constructed in the same format as a 
video frame signature so that it can be processed in 
the same way. Such an audio signature may be used 
to recognize broadcast radio segments, or may be 
used to confirm the identification of a video segment 
the data for which includes a high percentage of sus- 
pect data. However, the use of audio signatures is not 
necessary to the invention. 

The parametized "frame signature" information is 
stored in a circular buffer large enough to hold, pre- 
ferably, approximately twice as much signal informa- 
tion as the longest broadcast segment to be identi- 
fied. When a segment signature is being compared to 
the frame signature data, for each frame that passes 
the observation point eight comparisons between the 
segment signature data and the frame signature data 
are made, one word at a time, using the offset data 
stored with the segment signature to choose the 
frame signatures for comparison. The frame signa- 
ture and segment signature words are compared us- 
ing a bit-by-bit exclusive-NOR operation, which re- 
turns a 1 when both bits are the same and a 0 when 
they are different. The number of ones resulting from 
the exculsive-NOR operation is accumulated over all 
eight word comparisons. It is not necessary actually 
to construct a "parameter signature", by in fact con- 
catenating the offset parametized frame signature 
words, in order to make the comparison. If the number 
of ones accumulated by the exclusive-NOR operation 
exceeds a predetermined default threshold, modified 
as discussed below, a match is considered to have 
occurred for the frame at the observation point 

Signatures are assigned to segments as follows: 

A plurality, preferably eight, words are selected 
from the parametized segment meeting the following 
criteria: stable data, noise-free data, Hamming dis- 
tance, and entropy. 

Stable data means the word selected must have 
some minimum duration in the broadcast segment — 
i.e., it is derived from a portion of the segment for 
which there are at least a minimum number of (e.g., 
20 or more) frames of the same or similar data). 

Noise-free data are data having an associated 
mask word with a maximum number of unmasked 
bits. (Maximization of duration or stability, and mini- 
mization of masked bits or noise, can be two compet- 
ing criteria.) 

Hamming distance refers to the dissimilarity of 
the digital data. It is desirable for more positive and re- 
liable identification of broadcast segments that a sig- 
nature for one broadcast segment differ from that for 
another broadcast segment by at least a minimum 



number of bits, known as the Hamming distance. In 
generating the second or any subsequent signature 
in the database, Hamming distance from existing sig- 
natures must be considered. 

5 Entropy refers to the desirability, discussed 

above, of having the minimum possible correlation 
between different portions of the data. For this rea- 
son, given the preferred signature data length (8 
words, 16 bits per word), preferably no two signature 

10 words should be taken from points closer together in 
the segment than one second. This sets a lower limit 
on the length of broadcast segments which can be be 
reliably recognized. If, e.g., eight words make up a 
signature, and they must be at least one second 

15 apart, the shortest segment that can be reliably rec- 
ognized is a segment of approximately ten seconds in 
length. 

Using these criteria, eight frame signatures are 
selected from the parametized segment and an eight- 

20 word segment signature made up of those eight 
frame signatures is generated and stored. The dura- 
tion criterion and mask words are also stored with the 
segment signature for use in the recognition process. 
The duration parameter signifies that, because the 

25 frame data are stable for some time period, a certain 
number of successive matches on that data should be 
* obtained during the recognition process. If signifh 
cantly more or fewer matches are obtained, the latch- 
es are discarded as statistical anomalies. The mask 

30 data define a threshold parameter which is used dur- 
ing the recognition process to adjust the default num- 
ber of matching bits required before a signature is 
considered to have matched the broadcast data. For 
example, a default threshold could be set for the sys- 

35 tern which, during an attempt to match a particular 
segment signature, is lowered by one-half the num- 
ber of masked bits associated with that signature. 

If the designated frame keyword lookup techni- 
que is to be used, a keyword is chosen from within the 

40 segment. Having a buffer at least twice as long as the 
longest segment to be identified assures that suffi- 
cient broadcast signal history to make a recognition 
remains in the buffer at the time the keyword reaches 
the observation point. The criteria used for choosing 

45 the keyword are similar to those for choosing the sig- 
nature words - it should be of stable duration and rel- 
atively noise free, augmented by the need for a "level 
list" - i.e., there should be no more than about four 
signatures having the same keyword so that the nec- 

$o essary computations can be made within the the 1/30 
second real-time limit. 

Although using the keyword technique requires 
that in general only four comparisons need be made 
(because there are up to four signatures assigned to 

55 each keyword), additional comparisons are made to 
allow for the possibility of error in the parametization 
of the broadcast signal (occur- ring, e.g., because of 
noise in the transmission of the signal). Such add'h 
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tional comparisons lessen the probability of inaccur- 
ately recognizing a broadcast segment. If an error rate 
of one bit per frame signature is assumed, then in ad- 
dition to the nominal keyword, sixteen additional key- 
words (obtained by successively complementing 
each different bit of the nominal keyword) are also 
checked. If each of the seventeen keywords checked 
has four signatures associated with it, then sixty-eight 
comparisons must be made within each 1/30 second 
interval. If an error rate of two bits per frame signature 
is assumed, then the number of keyworbs increases 
to 

2 16 

1 ( ) = 137, 
i=0 i 

requiring 548 comparisons. Given the current state of 
computer technology, this is still possible within the 
1/30 second interval. 

Before a signature can be constructed for a seg- 
ment for addition to the segment signature data base, 
it must be determined that a broadcast segment is be- 
ing received. In some cases, new segments may be 
played into the system manually — e.g., where an ad- 
vertiser or advertising agency supplies a video tape 
of a new commercial or commercials. In such a case, 
the operator and the system know that this is a new 
segment, the signature for which is not yet stored in 
the segment signature library. However, it can hap- 
pen that a new commercial is broadcast by a local 
broadcast station for which no videotape was earlier 
supplied and which, therefore, is not yet known to the 
system. Therefore, the present invention also can de- 
tect the presence in the incoming signal of potential 
segments to be recognized that are new and present- 
ly unknown. For this purpose only (i.e., to detect but 
not to recognize), the present invention relies on the 
presence in the broadcast signal of signal artifacts 
characteristic of such potential unknown segments. 
These artifacts can include fades -to- black, audio 
power changes including silence ("audio fade- to- 
black"), and the presence (but not the content) of pre- 
encoded identification data appearing, e.g., in the 
vertical intervals of video signals. These artifacts are 
not assumed to indicate the presence of a new, un- 
known segment to be recognized per se. Rather, they 
are used as part of a decision-making process. For 
example, if two artifacts occur 30, 60 or 1 20 seconds 
apart near the hour or the half-hour, and no known 
segment was identified during the time between their 
occurrence, there is a high probability that a new and 
unknown segment of interest was present. On the 
other hand, if the interval between signal artifacts is 
accounted for by identified segments, the artifacts 
are not used or otherwise relied upon by the system 
and the fact that the artifacts occurred is deleted from 
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memory. Other possible indications of the presence 
of new and unknown segments of interest are the oc- 
currence of two known segments separated by 30, 60 
or 120 seconds, or some other interval during which 

5 no known segments were identified, or the occur- 
rence of one signal artifact separated in time from a 
known segment by such an interval. Once it is deter- 
mined that a new and unknown segment of interest 
may be present, the parametized information derived 

10 from the unknown segment is saved along with audio 
and video information corresponding to the unknown 
segment. The signal artifacts that marked the un- 
known segment are not retained, nor is any record 
kept of what they were. 

15 The saved audio and video information is ulti- 

mately presented, in compressed form (as discussed 
below), to an operator for use in identifying the new 
and unknown segment and recording the identi- f ica- 
tion in the segment signature library. The operator 

20 also records any special requirements needed to pre- 
pare a signature for the segment. For instance, some 
national commercials include two portions: a portion 
which is always the same irrespective of in which part 
of the country the commercial is to be broadcast (the 

25 "constant" portion), and a portion which differs de- 
pending on where the commercial is to be broadcast 
(the "variable" or "tag" portion). It is important to ac- 
curately identify different versions of such national 
commercials. If a commercial for a national product 

30 has a tag that is specific to one region, the commer- 
cial is considered different from the same commercial 
tagged for a different region. Therefore, the operator 
would note that the signature must include data from 
the tag portion of the segment, and that additional 

35 data must be taken from the tag. A signature is then 
generated automatically as described above. 

The ability to differentiate between otherwise 
identical commercials having differing tags is one im- 
portant feature of this invention. Two different ap- 

40 proaches are used, depending on the type of tag as- 
sociated with the commercial. One type of tag is 
known as a "live tag", which is a live-action audio/vid- 
eo portion of at least five seconds duration. Another 
type of tag is known as a "still tag" which is a still pic- 

45 ture — e.g., of text — which has insufficient video con- 
tent for generating a unique signature. Either type of 
tag can occur anywhere in the commercial. 

When a live tag is involved, a separate signature 
is generated for the tag. The system logs both the 

50 commercial occurrences and the tag occurrences, 
and then merges that data with the help of pointers in 
the signature database. For a still tag, a flag or poin- 
ter associated with the commercial signature triggers 
a brute force video comparison of a frame of the tag 

55 with a frame of the reference tag or tags. This com- 
parison is not necessarily done in real time. 

A system constructed in accordance with the 
present invention is preferably composed of one or 
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more local sites and one central site. Utilizing the rec- 
ognition methods described above, a local site scans 
one or more broadcast video and audio television sig- 
nals looking for known broadcast segments. If a 
known segment is detected, the local site records 5 
time and date information, the channel being moni- 
tored, the identification of the segment, and other in- 
formation in its database. Relying on signal artifacts, 
the local site also notes and records signals that it 
senses are likely to be new segments of interest 10 
which are not yet known to the system. 

On a periodic basis, the central site communi- 
cates, e.g., via telephone lines, with the local sites to 
determine what known broadcast segments have 
been detected and what potential but unknown seg- 15 
ments have been seen and saved, and to disseminate 
to appropriate local sites segment signature and de- 
tection information corresponding to new broadcast 
segments not yet known to those local sites. It is an- 
ticipated that the ultimate identification of a new and 20 
unknown segment will require visual or aural interpre- 
tation by a human operator at the central site. 

FIG. 2 illustrates a block diagram of the system 
including a central site 22 and a plurality of linked lo- 
cal sites 21 . Each local site 21 monitors broadcasting 25 
in its geographic region. Preferably, the local sites 21 
are located at cable television head end stations to 
assure a clear input signal. The local site 21 is capable 
of recognizing and identifying known broadcast seg- 
ments and logging occurrences of such segments by 30 
date, time, duration, channel, identification, and 
other desirable infor- mation. The local site is also ca- 
pable of recognizing the occurrence of potentially and 
new unknown segments, and of generating tempor- 
ary key signatures for such unknown segments so 35 
that it can maintain a log of all occurrences of each 
such segment pending the identification of the seg- 
ment by the central site 22. Local site 21 sends to cen- 
tral site 22 via communications channels 23a, b all log 
information for recognized known segments, plus in- 40 
formation relating to all potential new and unknown 
segments, and receives in return software updates, 
signature library updates, and requests for additional 
information. If a new signature transmitted to and re- 
ceived by one local site 21 originated as an unknown 45 
segment originally transmitted to the central site by 
that local site 21 , the local site 21 merges the tempor- 
ary log into other data awaiting transmission to cen- 
tral site 22, and then purges the temporary signature 
from its database. 50 

One local site 21a is located at or near the central 
site 22 and is connected to the remainder of central 
site 22 by high-speed direct data line 24. This "cen- 
tral-local" site is identical to the other local sites 21 
and serves the same function as the other local sites 55 

21 for the broadcast market in which it and central site 

22 are located. However, because central-local site 
21a is connected to central site 22 by direct high- 



speed data link 24, new segments monitored by cen- 
tral-local site 21a are quickly available to central site 
22 for identification. The signatures for those new 
segments that are of national scope can then be 
quickly disseminated to the remote local sites 21 to 
minimize the number of times a local site 21 will clas- 
sify a received segment as an unknown, and thereby 
to prevent communications channels 23a, b from be- 
ing burdened unnecessarily with the transmission of 
signature and other data (compressed audio and vid- 
eo) corresponding to locally unknown national seg- 
ments. 

Because the audio and video information corre- 
sponding to new and unknown segments must be 
transmitted to the central site 22 via comunications 
channels 23a, b to be reviewed by an operator during 
the identification process, the data is gathered by lo- 
cal site 21 in a compressed format to reduce commu- 
nications overhead and expense. 

Compression of the video data preferably is ac- 
complished as follows. First, not every frame is cap- 
tured. Preferably, only one frame every four seconds 
is captured to create a "slide show" effect, with an op- 
tion at the request of an operator at central site 22 to 
capture frames more frequently. Second, as is well 
known, a television video frame consists of two inter- 
laced fields occurring 1/60 second apart In the "slide 
show", small motion between the fields causes a no- 
ticeable flicker. Therefore, only one field is captured, • 
which still provides a recognizable image. Third, not 
all pixels are necessary for a sufficiently recogniz- 
able image. It has been found that 160 x 120 pixels is 
sufficient, with an option at the request of an operator 
at central site 22 to capture 320 x 240 pixels per field. 
Fourth, it is not necessary to capture color informa- 
tion. 

Audio compression is more difficult to accom- 
plish. Considerable information can be removed from 
video data while still maintaining a recognizable im- 
age. However, only a smaller amount of information 
can be removed from audio data without the remain- 
ing audio becoming difficult or impossible to under- 
stand, or unacceptably fatiguing for human operators. 
In view of this, the preferred method of audio com- 
pression is Adaptive Differential Pulse Code Modula- 
tion (ADPCM), which is used by the telephone indus- 
try and thus produces "telephone quality" audio. 
ADPCM techniques and circuitry are well known. 

When local site 21 detects a potentially new and 
unknown broadcast segment, the frame signature 
data and the temporary segment or key signature 
generated for that unknown segment, and the com- 
pressed audio and video information for that seg- 
ment, are stored. The local site 21 is polled periodical- 
ly by central site 22 and at those times the stored 
frame signature data and the temporary signatures 
are transmitted to central site 22 for identification via 
communications channels 23a, b. As discussed be- 
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low, the audio and video information are transmitted 
optionally, but these data are always stored by local 
site 21 until the identification and signature of the 
segment are returned by the central site 22. 

When central site 22 receives the frame signa- 5 
ture data and temporary key signature corre- spond- 
ing to an unknown segment from the local site 21 , sig- 
nature co- processor 25 associated with central site 
22 first checks the frame signature data against the 
global signature database, which contains all signa- 10 
tures from all local databases for all broadcast seg- 
ments known to the system, to determine whether or 
not the "unknown" segment in fact previously had 
been identified and is already known to the system 
(perhaps because a different local site saw the broad- 15 
cast segment before), but the signature for which had 
not yet been sent to all local sites 21 or had been iden- 
tified as being of limited geographic scope and so 
sent to only some of local sites 21. If the unknown 
frame signature data match a signature in the global 20 
database, the global signature for that segment 
(which may differ somewhat from the temporary sig- 
nature) is transmitted back to the originating local 
site, and the originating local site 21 is instructed to 
replace the temporary key signature generated local- 25 
ly with the global key signature. If the frame signature 
data are not matched to a signature in the global da- 
tabase, the corresponding temporary key signature is 
added to a separate portion of the global database 
used to store temporary signatures. This "temporary 30 
global data-base" allows coprocessor 25 to carry out 
the grouping of like unknowns, previously discussed, 
because if the same unknown comes in from another 
local site 21 it should be matched by the temporary 
signature stored in the global database, thereby indi- 35 
eating to copro- cessor 25 that it is probably the same 
segment which has already been sent by another lo- 
cal site 21 . 

At the same time that the temporary signature for 
a new segment is stored by coprocessor 25 in the glo- 40 
bal database, coprocessor 25 causes host computer 
27 to request the compressed audio and/or video data 
from local site 21 if those data have not already been 
transmitted. For economy in communications, audio 
and video data preferably are not initially transmitted 45 
from local sites 21 on the theory that the frame sig- 
nature data may be identified as a known segment 
upon comparison to the global database. However, 
for some "hot" markets where new segments fre- 
quently originate (e.g. Chicago, Los Angeles and New 50 
York), the audio and/or video data may also have al- 
ready been sent for another segment in the group. 
Further, audio and video need not both necessarily be 
transmitted. For some new and unknown segments, 
perhaps only the audio, or only the video, can enable 55 
the identification, while for other new and unknown 
segments both will be necessary. If no data for the 
audio or video had been sent, the operator will re- 



quest one set of data. In this case, unknown segment 
data are stored until the missing audio or video data 
arrive, and then queued to an operator workstation 
26. If the operator determines that the audio (if only 
video was sent) or video (if only audio was sent) data 
are also needed, the unknown data are again stored 
until the missing information arrives, when the data 
are requeued. Similarly, the operator may determine 
that higher resolution video (320 x 240 pixels or more 
frames per second) is needed and the unknown data 
again are stored. In a case where high resolution vid- 
eo is requested, if local site 21 always captures the 
high resolution video and simply does not transmit it 
for purposes of economy, it can be transmitted quick- 
ly on request However, the system may be imple- 
mented in such a way that local site 21 does not rou- 
tinely capture the high resolution video, in which case 
it is necessary to wait until the segment is broadcast 
again in that locality. 

Once the operator has all of the necessary infor- 
mation, he or she then plays back the audio and/or 
video information to identify the unknown segment, 
specifying any special requirements for signature 
generation as discussed above. The operator may 
also determine that the information captured as a re- 
sult of the signal artifacts is actually two segments 
(e.g., in a 30-second interval, two 15-second com- 
mercials occurred), or that two consecutive intervals 
were each half of a single segment (e.g., two 30-sec- 
ond segments represent one 60-second commer- 
cial). In such a case, the operator instructs the sys- 
tem to break up or concatenate the segments, recre- 
ate the frame signature and segment signature data, 
and restart the identification process for the resulting 
segment or segments. 

After an operator has identified the seg- ment, 
the frame signature data for each segment in the 
group must be aligned with the frame signature data 
for each other segment in the group before a global 
key signature can be constructed. Alignment is nec- 
essary because different segments in the group may 
have been captured by local sites 21 by the detection 
of different artifacts. Thus, the segments may not all 
have been captured identically - i.e., between the 
same points. For example, a set of segment data in a 
group for a broadcast segment nominally 60 seconds 
in length may in fact, as captured, be only 55 seconds 
in length because the segment was broadcast incom- 
pletely. Or, a member segment of the group may be 
too long or too short because it was captured as a 
consequence of the detection of a fade-to-black arti- 
fact or of an audio power change artifact 

Alignment is carried out by coprocessor 25. First, 
the frame signature data for the first segment in the 
group are placed in a buffer. Next data for a second 
segment are clocked word-by-word into another buf- 
fer and an exclushve-NOR between all bits of the two 
segments is continually performed as the second 
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segment is docked in. When the aggregate number 
of ones returned by the exclusive-NOR is at a maxi- 
mum (meaning that the compared bits are the same 
— either zeroes or ones), alignment has been ach- 
ieved. The aligned data then are used as a base-line 5 
to align the remaining segments in the group. The 
alignment process is time-consuming. However, it is 
not necessary that alignment be done on real-time 
basis. Preferably, alignment is performed at night or 
at some other time when system activity is at a low 10 
point. 

Once the parametized data for all segments with- 
in a group have been aligned, a best fit of both the 
frame signature data and the mask data is calculated 
by assigning to each bit position the value of that bit 15 
position in the majority of segments. The signature 
coprocessor 25 then generates a new global signa- 
ture for the segment using the best fit parametized 
data. 

After the new global signature has been generat- 20 
ed, it is compared to the frame signature data for all 
of the unknown segments in the group to which it ap- 
plies to make certain that the data for each segment 
matches the signature. If the new global signature 
does not latch each set of frame signature data, this 25 
signifies either that an error was made in selecting 
the keyword or another of the data words, or that one 
or more sets of data in the group are really not repre- 
sentative of the same segment In such a case, an op- 
erator may have to view additional segments in the 30 
group. 

If the new global signature matches each group- 
ed segment, the signature is transmitted back to each 
local site 21 or to an appropriate subset of local sites 
if the newly identified segment is not of national 35 
scope. The respective local sites 21 then merge the 
data they had been keeping based on the temporary 
signatures and send it to central site 22, replace the 
temporary signatures they had been retaining with 
the new global signature in their local databases, and 40 
purge the audio, video, and frame signature data for 
that segment. 

II. Preferred Embodiments 

45 

A first preferred embodiment of a local site 30 is 
shown diagrammatical ly in FIG. 3, and includes an 
IBM PC personal computer 31 and two Intel 310 com- 
puters 32 33, interconnected by conventional RS- 
232C serial links 34, 35. Personal computer 31 uses so 
a circuit card 36 and a software program to extract 
video parameter data from incoming video signals. 
Computer 32 creates signatures for new and un- 
known segments and matches existing signatures 
maintained in a signature library against incoming 55 
frame signature data. Computer 33 logs the "hits" or 
matches made by personal computer 32. 

A frame grabber card 36, such as the PC Vision 
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Frame Grabber by Imaging Technologies, in personal 
computer 31 generates 512 x 256 pixels for each 
frame of incoming video information. However, frame 
grabber 36 is utilized so that only one field per frame 
is sampled. Frame grabber 36 also provides a video 
field clock that is used by computer 31. Computer 31 
processes the frame grabber output to produce a 
four-bit word representing each frame. A flow chart of 
a computer program used in personal computer 31 is 
shown in FIG. 4. The flowchart will be readily under- 
stood by those of ordinary skill in the art. 

The parametized data from personal computer 
31 are transmitted over serial link 34 to computer 32 
where they are clocked into a section of RAM parti- 
tioned, using pointers, as a modulo-2048 circular buf- 
fer. The buffer holds 34 seconds of data. Frame grab- 
ber 36 and personal computer 31 are too slow to grab 
all of the frame data in real time (although in the sec- 
ond preferred embodiment, described below, this 
function is performed by hardware which does oper- 
ate in real time). Resultantly, some data are lost. 
However, the data that are provided over serial link 34 
are inserted into the buffer in their current real-time 
positions. Computer 32 "backfills" the buffer by filling 
in the empty positions with the next succeeding real 
time data. Computer 32 creates signatures and 
matches incoming frame signature data to a signa- 
ture data-base as described above, without using the 
designated frame keyword lookup technique. A.f low- 
chart of the signature generation program is shown in 
FIG. 5. A flowchart of the signature detection program 
is shown in FIG. 6. The flowcharts will be readily un- 
derstood by those of ordinary skill in the art. 

For the purposes of creating signatures in this 
embodiment, each segment is divided into nine sec- 
tions — a half-section at the beginning, followed by 
eight full sections, and a half-section at the end. The 
two half-sections are discarded to account for possi- 
ble truncation of the beginning or end of the segment 
when it is broadcast A word is then selected, using 
the previously described criteria of stable data, noise- 
free data, Hamming distance, and entropy, from each 
of the eight sections. The signatures created are stor- 
ed in the memory of computer 32 while the match 
data are transmitted over serial link 35 to computer 33 
which keeps track of the matches. A flowchart of a 
program used in computer 33 is shown in FIG. 7. The 
flowchart will be readily understood by those of ordi- 
nary skill in the art. 

Signatures are generated in the system of FIG. 3 
by the computer 32. However, the generation of sig- 
natures is not initiated as earlier described and as im- 
plemented in the second preferred embodiment (de- 
scribed below). Rather, in the system of FIG. 3, an op- 
erator must "prime" the system by specifying the seg- 
ment length, playing a tape into the system and man- 
ually starting the buffer filling process. Computer 32 
then builds a signature automatically. However, there 
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is no threshold or guard- band computed here as was 
earlier described, and as implemented in the second 
preferred embodiment (described below). In the sec- 
ond preferred embodiment, a threshold asso- ciated 
with the signature is modified by subtracting from the 5 
default threshold one-half the number of masked bits 
in the signature, while in the system of FIG. 3 the de- 
fault threshold is augmented at the time of compari- 
son by one-half the number of masked bits in the data 
being compared. 10 

A second preferred embodiment of the system of 
the invention is shown in FIGS. 8-12. 

FIGS. 8-11 B show the details of local sites 21. 
FIG. 8 is a block diagram of local site 21 . The local site 
21 is comprised of two major subsystems: the signal 15 
processing subsystem 80 and the control computer 
81. 

The signal processing subsystem 80, shown in 
more detail in FIG. 9, receives incoming RF broadcast 
signals and performs three distinct tasks: 20 

1 . It recognizes "known" broadcast segments by 
comparing received frame signature data to local 
library of segment signatures; 

2. It detects artifacts in the received broadcast 
signal for the purpose of delineating and captur- 25 
ing potential "unknown" broadcast segments 
whose frame signature data do not match any lo- 
cally stored segment signature; and 

3. It collects data (e.g., compressed video and au- 
dio, time of day, and so forth), to allow subse- 30 
quent identification of "unknown" segments by 

an operator at the central site. Hardware per- 
forms much of these tasks to provide maximum 
speed of operation. In addition, software-driven 
microprocessors cooperate with the hardware to 35 
assist with the lower speed portions of these 
tasks and to allow programmability and flexibili- 
ty. 

The hardware of signal processing subsystem 80 
includes matching module 82, compression module 40 
83, and one or more tuners 84 (there is one tuner for 
each broadcast station to be monitored). Tuner 84 
may be any conventional RF tuner, and in the prefer- 
red embodiment is Zenith model ST-3100. Matching 
module 82 and compression module 83 are built 45 
around the well-known Intel Corporation Multibuse II 
Bus Structure. Multibuse II is described in the Multi- 
buse II Bus Architecture Databook (Intel Order No. 
230893) and the Multibuse II Bus Architecture Spec- 
ification Handbook (Intel OrderNo. 146077C), bothof so 
which are incorporated herein by reference. The first 
two tasks discussed above are performed in match- 
ing module 82. The third task is performed in com- 
pression module 83. 

Each of the two modules 82, 83 includes a Cen- 55 
tral Services Module (CSM) 90 which is a standard 
of f-the-shelf item (such as Intel OrderNo. SBC-CSM- 
001) required in all Multibuse II systems. Each module 



also has an executive microcomputer board 91a, 91b 
which controls communications between the respec- 
tive module and control computer 81 . All components 
on each module are interconnected on public bus 92, 
while those components which require large amounts 
of high-speed data transfer between them are addi- 
tionally interconnected by private bus 93. 

Matching module 82 further includes one channel 
card 94 for each channel to be monitored — e.g., one 
for each commercial station in the local market Chan- 
nel cards 94 generate the 16 bits per frame of para- 
metized signal data and the corre- sponding 16-bit 
mask for both audio and video in accordance with the 
methods earlier described. Channel cards 94 also 
signal the occurrence of signal artifacts which indi- 
cate, and are used to delineate and capture, potential 
unknown segments. Also contained within matching 
module 82 are two circular buffer memories 95. One 
buffer 95 is for audio and the other is for video. These 
buffers store on a temporary basis the incoming par- 
ametized frame signature data, as earlier described. 
In this preferred embodiment, the maximum length of 
broadcast segments to be recognized is assumed to 
be one minute. For longer segments, only a one-min- 
ute portion is used for recognition purposes. Accor- 
dingly, each buffer can hold 4,096 frames, which is 
136.5 seconds, of video at a frame rate of thirty 
frames per second, or just over two minutes. 4,096 is 
2 12 , so the offset data associated with each sig- na- 
ture (as earlier described) is 12 bits long. Parame- 
tized signal information is moved from channel cards 
94 to the circular buffers 95 when requested by exec- 
utive microcomputer 91 a. 

Matching module 82 also includes correlation 
card 96, shown in more detail in FIG. 10. Correlation 
card 96 performs the task of recognizing incoming 
broadcast segments. Correlation card 96 accom- 
plishes this by comparing incoming video and audio 
frame signature data with the locally stored database 
of key signatures to find matches. The local signature 
database is stored in memory 97 (up to 13 megabytes 
of conventional random access memory). Since cor- 
relation card 96 in the preferred embodiment may op- 
erate on both audio and video data (although, e.g., 
only video can be used), correlation card 96 must 
have sufficient capacity to process an amount of data 
equivalent to twice the number of channels to be 
monitored. 

Correlation card 96 performs all functions re- 
quired to generate the raw data for the final correla- 
tion, or determination of a segment match. Executive 
microcomputer 91a accumulates the matches result- 
ing from key signature comparisons done by correla- 
tion card 96, and then transmits the accumulated 
matches to control computer 81 . 

As shown in FIG. 10, correlation card 96 contains 
signature comparison processor (SCP) 101 and two 
independent interfaces 102, 103 to the Multibuse II 
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public and private buses. SCP 101 is a programmable 
element which operates under command of executive 
microcomputer 91a. SCP 101 is responsible for the 
following primary functions: 

1 . Generation of all addresses to data-base mem- 
ory 97 for the purpose of accessing key signa- 
tures, current circular buffer data, and segment 
signatures (the latter when this card is used in the 
coprocessor as described below); 

2. Performing the actual bit-by-bit comparison of 
frame signature data and stored segment signa- 
tures; 

3. Execution of self-test diagnostic functions as 
requested by executive micro- computer 91 a; and 

4. Relaying results of each key signature compar- 
ison to the executive microcomputer 91a for final 
segment correlation. 

Control unit 1 04 of SCP 101 directs the operation 
of SCP 101. Control unit 104 includes memory which 
contains all microprogram instructions defining SCP 
operation. It also contains sufficient functionality to 
allow for the efficient sequencing of the required mi- 
croinstructions. Control unit operation is directed, at 
an upper level, by instructions generated by execu- 
tive microcomputer 91a. 

Logic unit 1 05 performs all address and data ma- 
nipulations required to load both incoming and previ- 
ously defined reference signatures into onboard buf- 
fers for comparison. Signature data is resident in ex- 
ternal, offboard memory accessible by the private 
bus; logic unit 105 and control unit 104 together exe- 
cute all private bus interface functions. 

Logic unit 1 05 also generates messages to and 
interprets messages from executive microcomputer 
91a. An example of a message interpreted by logic 
unit 105 is a request to compare selected key signa- 
tures in the key signature database to the current, in- 
coming segment signature. An example of a message 
generated by logic unit 1 05 is that which is generated 
at the end of a comparison which defines how well the 
incoming signature matches the reference (how many 
total correct or incorrect bits after comparison). 

The logic unit peripheral hardware module 106 is 
responsible for assisting logic unit 105 in performing 
signature comparisons. Specifically, the module con- 
tains logic which is intended to increase the process- 
ing capability of SCP 101. The features of module 106 
are: 

•1. Programmable memories which contain con- 
stant data; 

2. Word swap hardware which allows information 
in internal logic unit registers to be positional I y 
exchanged at high speed; and 

3. Hardware which counts the number of active 
bits in a preliminary signature comparison result, 
in preparation for testing against a predetermined 
threshold. 

Executive microcomputer 91a is a standard com- 



mercial microcomputer card (e.g., Intel Order No. 

SBC-286-100) based on an 80286 microprocessor. 

The function of this card is to: 

1 . Maintain the signature data base; 
5 2. Transfer data from the channel cards to the cir- 

cular buffers; 

3. Maintain the keyword pointers; 

4. Accumulate the correlation results (for use in 
applying the duration criterion); 

10 5. Capture data for segment identification; and 

6. Provide an interface path to the control com- 
puter 81 . (All data to be transferred to central site 
22 is requested by control computer 81 . The key 
signature database is down-loaded from control 
15 computer 81 .) 

Compression module 83 includes (in addition to 
central services module 90 and executive micro- 
computer 91 b) audio capture card 98a, video capture 
card 98b, and associated circular buffer memories 
20 99a, 99b. The audio and video capture cards are 
shown in more detail in FIGS. 11 A and 11B, respec- 
tively. 

Audio and video capture cards 98a, 98b each can 
monitor up to eight broadcast channels (monitoring 

25 more channels requires multiple cards). Video card 
98b captures incoming video frames at a slide-show 
rate of one frame per second and digitizes and com- 
presses the video data, while audio card 98a digitizes 
and captures audio continually, for each of the eight 

30 channels. 

The audio and video from up to eight channels 
are brought to these cards (as well as to the channel 
cards) from channel tuners 84 by coaxial cables. On 
video capture card 98b, a conventional 1-of-8 multi- 

35 ' plexer 110 (implemented in this embodiment as a T- 
switch circuit design using CMOS 4066 integrated cir- 
cuits), selects one of the eight channels for capture. 

As shown in FIG. 11 A, on audio card 98a, the au- 
dio from each channel is fed to one of up to eight com- 

40 bination filter/coder/decoder circuits 111, such as a 
National Semiconductor 3054 integrated circuit. In 
combination circuit 111, the audio signal is passed 
through a low-pass f i Iter and then through a coder/de- 
coder which performs a logarithmic analog-to-digital 

45 conversion resulting in a digital signal with a com- 
pressed amplitude (the audio signal is expanded 
again prior to being audited by an operator at central 
site 22). The compressed digital signal is then passed 
through an adaptive differential pulse code modulator 

50 (ADPCM) 112 similar to that used by the telephone in- 
dustry — e.g., a NEC 7730 integrated circuit — for fur- 
ther compression. An Intel 80188 microprocessor 113 
controls the movement of the compressed audio data 
from ADPCM 112 through bus interface 1 14 to private 

55 bus 93 of compression module 83, and thence to cir- 
cular buffer memory 99a. A JEDEC-standard RAM- 
/EPROM 11 3a contains programs and memory work- 
space used by microprocessor 113. 
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As shown in FIG. 11 B, on video card 98b f com- 
mon video circuit 115 uses the sync information con- 
tained in the received analog video signal to generate 
clock pulses and addresses for analog-to- digital con- 
version of the video signal. Circuit 115 outputs both 5 
address signals and digitized data signals represent- 
ing the video at the rate of one field per second at 116 
and 117, respectively. The data pass to arithmetic log- 
ic unit (ALU) 118 which further compresses the video 
data by reducing each video field or frame to 160 (nor- 10 
izontal) by 120 (vertical) pixels, each pixel averaging 
four- by-two pixel areas in size, using gray scale pixel 
averaging. The address data pass from common vid- 
eo circuit 115 to dither prom 119 which contains a ta- 
ble of pseudorandom numbers — one for each video 15 
address output by circuit 115. When an address is re- 
ceived by dither prom 119, the pseudorandom num- 
ber associated with that address is passed to ALU 118 
to be added to the compressed video data. This dith- 
ering technique, by which a low-information-content 20 
video signal can be visually improved, allows the vid- 
eo frame to be compressed to as few as 9600 bytes. 
The dithered compressed video data are then passed 
to one of two line buffers 1101a, b (one buffer is filled 
while the other is being read and emptied), from 25 
which they are passed under the control of direct 
memory access controller 1102 to private bus 93 of 
compression module 83, and thence to circular buffer 
memory 99b. 

The audio and video data are placed in circular 30 
buffers 99a and 99b holding the most recent two min- 
utes of data for that channel under the direc- tion of 
control computer 81 and executive microcomputer 
91b. Executive microcomputer 91b preferably is a 
standard commercial microcomputer card (e.g., Intel 35 
order No. SBC-286-100) based on an 80286 micro- 
processor. This card provides an interface path to the 
control computer 81. All data to be transferred to the 
central site is requested by control computer 81. 

The signal processing subsystem 80 can be re- 40 
ferred to as the "front end" of local site 21. Control 
computer 81 can be referred to as the "back end". 

Control computer 81 (FIG. 8) is preferably a com- 
mercially available MicroVAX II minicomputer manu- 
factured by Digital Equipment Corporation (DEC), 45 
running the DEC VMS virtual memory operating sys- 
tem. Between one and nine megabytes of RAM mem- 
ory are provided along with one DEC RA81 Winches- 
ter disk drive (with controller) having a capacity of 456 
megabytes. A DPV11 synchronous interface con- so 
nects the control computer 81 to communications 
channels 23a, b via a modem. A DRV11 direct mem- 
ory access controller connects control computer 81 
to signal processing subsystem 80. 

A function of control computer 81 is to determine, 55 
using detected signal artifacts, when new and as yet 
unknown broadcast segments may have been re- 
ceived. Control computer 81 also keeps track of the 



temporary log for such segments until the segments 
have been identified by central site 22. Another func- 
tion of control computer 81 is to determine, based on 
duration and other criteria, such as time of day, 
whether or not matches accumulated by executive mi- 
crocomputer 91a actually indicate that a segment has 
been recognized. (For example, during "prime time" 
no commercials are normally broadcast at, e.g., 7 
minutes after the hour.) In performing these func- 
tions, control computer 81 exercises its ability to con- 
trol all segment processing subsystem 80 functions 
via executive microcomputers 91a, 91b. 

Control computer 81 can instruct modules 82 and 
83 to tune to a particular channel to capture audio/vid- 
eo data, to compare a pair of frame and key signa- 
tures, or to generate a local signature. These instruc- 
tions can originate in control computer 81 itself or ul- 
timately at central site 22. For example, in identifying 
a new segment, an operator may need higher resolu- 
tion video information. In such a case, control com- 
puter 81 would act on instructions from central site 22 
by requesting module 83 to capture the required data 
when the desired segment is next received. Control 
computer 81 also stores on disk a backup copy of the 
signature database stored in RAM memory 97. 

Referring again to FIG. 2, central system 22 in- 
cludes central-local site 21a, coprocessor 25, main- 
frame "host" computer and memory 27 with associat- 
ed mass storage device 28, communications proces- 
sor 29 and workstations 26. 

Coprocessor 25 is used to assist with certain 
computationally intensive functions related to the sig- 
nature processing requirements of the central site 22. 
The "front end" of coprocessor 25 is identical to 
matching module 82 of local site 21 , earlier described, 
except for the omission from coprocessor 25 of chan- 
nel cards 94. It is preferred, however, that the memory 
for the signature database within coprocessor 25 be 
expanded over that of the local site to ensure that all 
key signatures used at all local sites can be resident 
in coprocessor 25. 

The "back end" of coprocessor 25 preferably 
uses the same MicroVAX computer used by local 
sites 21 (FIG. 8), although a different type of comput- 
er could be used. Another alternative is that the co- 
processor front end may be attached to communica- 
tions processor 29 at the central site. It is also prefer- 
red that the coprocessor hardware be duplicated at 
central site 22 so that a backup system is available 
in case of a failure of the primary coprocessor. The 
coprocessor's signature generating and comparing 
functions are performed in the front end, while its 
checking and grouping functions are controlled by its 
back end utilizing the comparison capabilites of the 
front end as described above. 

Workstation 26 is the vehicle by which new and 
unknown segments are presented to, and classified 
by, human operators. A secondary function of work- 
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station 26 is to act as a terminal in the maintenance 
of host resident databases. Workstation 26 is made 
up of the following: 

1. A standard IBM 3270 AT computer capable of 
local processing and communicating with host 5 
computer 27; 

2. A 30 MB hard disk drive, 1.2 MB floppy drive, 
color console monitor and keyboard all attached 
to the 3270 AT; 

3. Two video monitors for viewing two segments 10 
simultaneously; 

4. One audio output device (e.g., headphones) for 
listening to the audio portion of a segment; 

5. A video card installed in the 3270 AT for con- 
trolling the video portions of segments; and 15 

6. An audio card installed in the 3270 AT for con- 
trolling the audio portion of segments. 

The heart of workstation 26 is the IBM 3270 AT 
computer. The 3270 AT is a blend of an IBM 3270 ter- 
minal and an IBM AT personal computer. By combin- 20 
ing the power of these components, a very effective 
mainframe workstation is created. Workstation 26 al- 
lows easy communication with host 27 and has its 
own processing capability. Up to four sessions with 
host 27 can be started as well as a local process all 25 
viewed in separate windows on the console screen. A 
combination of host and local processes are used by 
the operator. 

The video card contained in the 3270 AT can dis- 
play two different segments. Each video card con- 30 
sists of a pair of "ping-pong" (A/B RAM) memories for 
holding compressed gray scale video data. The ping- 
pong memories can be used in one of two ways. First 
a segment can be pre-loaded into RAM Awhile RAM 
B is being displayed. Second, the ping-pong memor- 35 
ies can be used to load the next frame of a segment 
while the other is being displayed. Gray scale data is 
returned to video format and smoothed before being 
passed through the video digital-to-analog converter. 

An audio control card is also provided in the 3270 40 
AT. ADPCM circuits (e.g., NEC 7730) on the audio 
control card expand the data and output a serial bit 
stream for conversion to analog information to be 
played on the operator's headphones. 

Workstation 26 supports the identification proc- 45 
ess of new commercial segments and contains self- 
test routines to check the status of the machine and 
components. It is possible for workstation 26 to oper- 
ate in a somewhat stand-alone mode requesting 
needed information from host 27 and passing results so 
back. Alternatively, host 27 could control the applica- 
tion and send audio/video requests to work-station 
26. The operator at workstation 26 controls the audio 
and video cards to cause the audio and/or video por- 
tions of selected segments to be displayed or output. 55 

Host computer 27 is preferably an IBM main- 
frame of the 308X series, such as an IBM 3083. Host 
computer 27 maintains a copy of the global signature 
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databast and an archive of all parametized and com- 
pressed audio/video data from which the signature 
database was generated. The archive allows recrea- 
tion of the signature database in the event, e.g., of an 
accidental catastrophic loss of data. 

Host computer 27 uses the following commercial- 
ly available software packages: 

1. Operating system - IBM MVS/XA; 

2. Communications software - IBM ACF/VTAM, 
MCP, MPAA; 

3. Telecommunications monitor- IBM CICS; and 

4. Database management system — Cullinet 
IDMS. 

Host 27 also commands the workstation 26, co- 
processor 25 and, ultimately, local site 21. For exam- 
ple, it may be determined that additional information 
is needed from a particular local site 21 . Host 27 acts 
on that determination by instructing the appropriate 
local site control computer 81 to request that its signal 
processing subsystem 80 capture additional data, or 
upload some data previously captured, for example. 

Host 27 also uses information transmitted by the 
various local sites 21 as to the occurrences of seg- 
ments to compile a log of occurrences and one or 
more reports requested by the system users. 

Communications channels 23a, b and communi- 
cations processor 29 are shown diagrammatically in 
more detail in FIG. 12. In the embodiment shown, co- . 
processor 25 has a separate control computer 121, 
although, as stated above, the functions of that com- 
puter could be handled by communications proces- 
sor 29. 

All communications within central site 22 and lo- 
cal sites 21 are coordinated by Digital Equip- ment 
Corporation (DEC) equipment. Therefore, communi- 
cations throughout the system are based on DEC'S 
DECNet protocol. Within central site 22, the DECNet 
protocol is run on a local area network 120. An SNA 
gateway 122 manufactured by DEC is connected to 
local area network 120 to translate between DECNet 
and IBM's Systems Network Architecture to allow 
communications between host 27 and the rest of the 
system. An IBM 3725 communications control device 
123 interfaces between SNA gateway 122 and host 
27. An IBM 3724 cluster controller 124 interfaces be- 
tween device 123 and workstations 26, allowing 
workstations 26 to communicate with host 27. Cen- 
tral-local site 21a is connected to local area network 
120 by high-speed link 24 as earlier discussed. 

Communications control computer 29 is prefer- 
ably a Digital Equipment Corporation VAX 8200. Co- 
processor control computer 121 is the identical com- 
puter and in fact, as discussed above, its function can 
be performed by communications control computer 
29 if desired. 

Communications control computer 29 interfaces 
between local area network 120 and local sites 21. 
For local sites 21 with which high-speed or high- 
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volume communications is necessary or desired — 
e.g., major "hot" markets such as New York, Chicago 
or Los Angeles - communication can be by high- 
speed leased line 23b. However, for most local sites 
21 , a lower speed packet switching data network 23a s 
running the well-known X.25 protocol is used. The 
X.25 protocol is transparent to DECNet and is avail- 
able on such commercial data communications net- 
works as Telenet or Tymnet Communication lines 
125 between individual local sites 21 and network 10 
23a can be provided either by leased line or over the 
telephone dial-up network. 

Thus it is seen that a method, apparatus and sys- 
tem has been provided for accurately (with a less than 
1 % error rate), rapidly and reliably logging the occur- 15 
rences of large numbers of broadcast segments with- 
out relying on cues or codes in the signal, and for iden- 
tifying new segments with a minimum of human in- 
volvement. 

Persons skilled in the art will appreciate that the 20 
present invention can be practiced by other than the 
embodiments described herein, which are presented 
for the purpose of illustration and not of limitation, and 
the present inventton is limited only by the claims that 
follow. 25 



Claims 

1. A method for continuous pattern recognition of 30 
broadcast segments, said method comprising: 

constructing a digital signature from a 
known sample of a segment to be recognized by 
digitally parametizing said segment, selecting 
portions (1 , to 1 16 ) from among random frame lo- 35 
cations throughout said parametized segment in 
accordance with a set of predefined rules to form 
said signature, and associating with said signa- 
ture the frame locations of said portions relative 
to a reference location; 40 

storing said signature and associated 
frame location information in a library of signa- 
tures, each signature in said library being identi- 
fied with a particular segment to be recognized; 

monitoring a broadcast signal; 45 

digitally parametizing said monitored sig- 
nal on a frame- by-frame basis; 

for each frame (1 0) of said parametized 
monitored signal, searching said library for a sig- 
nature potentially associated therewith and, us- so 
ing the frame location information associated 
with said potentially associated signature, com- 
paring said potentially associated signature to 
the appropriate frames (10) of said parametized 
monitored signal. 55 

2. The method of claim 1 , wherein: 

the step of constructing a digital signature 



from a known sample of a segment to be recog- 
nized comprises digitally parametizing said seg- 
ment by forming a string of digital words each rep- 
resenting one frame of said segment, identifying 
a word representing a designated frame in said 
segment, the association with said segment of 
the word representing 

said designated frame being nonexclusive, iden- 
tifying the offsets of said frame locations relative 
to said designated frame, and selecting a plural- 
ity of additional words each representing a re- 
spective one of the frames at said frame loca- 
tions; 

the step of storing said signature and 
frame location information comprises storing the 
word representing said designated frame and 
said plurality of additional words along with infor- 
mation representing the offsets of said frame lo- 
cations relative to said designated frame; 

the step of digitally parametizing said 
monitored signal comprises forming a plurality of 
monitored digital words each representing a 
frame of said monitored signal; and 

for each frame of said parametized moni- 
tored signal, the step of searching said library 
comprises searching said library for any signa- 
ture for which the monitored digital word repre- 
senting said frame also represents said designat- 
ed frame, and comparing the additional words of 
any such signature with the words of said para- 
metized monitored signal at said offsets relative 
to said monitored digital word. 

3. The method of either of claims 1 or 2, wherein 
said signature and parametized monitored signal 
are derived from video portions of said segment 
and said monitored signal. 

4. The method of either of Claims 1 or 2, wherein 
said signature and parametized monitored signal 
are derived from both audio and video portions of 
said segment and said monitored signal. 

5. The method of Claim 3 wherein said signature 
and said parametized monitored signal are de- 
rived from luminance values of said video por- 
tion. 

6. The method of Claim 5 wherein said signature 
and said parametized moniored signal are de- 
rived by comparing average luminances of select- 
ed areas (1, to 1 16 ) of a frame (10) of said seg- 
ment and monitored signal, respectively, to an 
average luminance of at least one reference area, 
each of said selected areas (1 1 to 1 16 ) providing 
a bit of respective one of said signature and said 
parametized monitored signal. 
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7. The method of Claim 6 wherein said selected 
areas (1 1 to 1 16 ) are asymmetrically spaced about 
the center of said frame (10). 

8. The method of either of Claims 6 or 7 wherein s 
said at least one reference area is said entire 
frame (10). 

9. The method of either of Claims 6 or 7 wherein 

said at least one reference area is, for each of 10 
said selected areas (^ to 1 16 ), a different prese- 
lected area of said frame (10). 

10. The method of either of Claims 6 or 7 wherein 

said at least one reference area is, for each of 15 
said selected areas (1 ^ to 1 16 ), the corresponding 
area of a previous frame. 

11. The method of either Claims 6 or 7 wherein said 

at least one reference area is, for each of said se- 20 
lected areas (1! to 1 16 ), a different preselected 
area (1' t to 1' 16 ) of a previous frame (10). 

12. The method of claim 4 wherein said signature 

and said parametized monitored signal are de- 25 
rived at least in part from a frequency spectrum 
of said audio portion. 

13. The method of claim 12 wherein said signature 

and said parametized monitored signal each do 
comprise a plurality of digital words, each digital 
word of said signature and said parametized 
monitored signal being derived by comparing se- 
lected frequency bands of said audio portion to at 
least one reference band, each of said selected 35 
bands providing a bit of said digital word. 

14. The method of any preceeding claim, further 
comprising reducing the amount of data on which 

said searching step is performed by selecting 40 
less than all of the data of the stored signatures 
to be searched. 

15. The method of claim 14 wherein said data reduc- 
tion step comprises associating a digital word 45 
representing a designated frame of said segment 
with the signature of said segment, said associa- 
tion being nonexclussive, the step of digitally par- 
ametizing said monitored signal comprises form- 
ing a plurality of digital words each representing so 
a frame of said monitored signal, and said 
searching step comprises, for each digital word in 

said parametized monitored signal, searching 
said library for any stored signature for which said 
digital word in said parametized nonitored signal 55 
corresponds with said digital word representing 
said designated frame. 



1 6. The method of any preceding claim wherein each 
of said segments includes a constant portion and 
a variable portion; and where said signature is 
constructed from a known sample of the constant 
portion of such a segment to be recognized; said 
method further comprising: 

recording additional data from known 
samples of said variable portion; 

storing said additional data with said sig- 
nature; 

associating with said stored signature an 
indication of the existence of said variable por- 
tion; 

using said additional data to identify the 
variable portion of a broadcast segment once the 
constant portion has been identified. 

17. The method of Claim 16 wherein: 

said step of recording additional data com- 
prises constructing a second signature for said 
variable portion; and 

said using step comprises identifying the 
variable portion of said broadcast segment with 
said second signature. 

18. The method of Claim 16 wherein: 

said step of recording additional data com- 
prises recording at least one video frame of said 
variable portion; and 

said using step comprises performing a di- 
rect comparison of said at least one video frame 
and at least one frame of said monitored broad- 
cast signal. 

19. Apparatus for continuous pattern recognition of 
broadcast segments, said apparatus comprising: 

means for constructing a digital signature 
from a known sample of segment to be recog- 
nized by digitally parametizing said segment, se- 
lecting portions (1-t to 1 18 ) from among random 
frame locations throughout said parametized 
segment in accordance with a set of predefined 
rules to form said signature, and associating with 
said signature the frame locations of said por- 
tions relative to a reference location; 

means for storing a library of signatures 
and associated frame location information, each 
signature, in said library being identified with a 
particular segment to be recognized; 

means for monitoring a broadcast signal; 

means for digitally parametizing said 
monitored signal on a frame-by-frame basis; and 

means for searching said library for a sig- 
nature potentially associated with each frame 
(10) of said parametized monitored signal and, 
using the frame location information associated 
with said potentially associated signature, for 
comparing said potentially associated signature 
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to the appropriate frames (10) of said parame- 
tized monitored signal. 

20. The apparatus of claim 19 wherein: 

said constructing means is operative to 
digitally parametize said segment by forming a 
string of digital words, each of said words repre- 
senting one frame (10) of said segment, said con- 
structing means being further operative to iden- 
tify a word representing a designated frame (10) 
in said segment, the association with said seg- 
ment of the word representing said designated 
frame (10) being nonexclusive, and select a plur- 
ality of additional words each representing a re- 
spective one of the frames (10) at said random 
frame locations; 

said storing means being operative to 
store in said library of signatures the digital words 
representing said designated frame (1 0) and said 
additional frames (10) along with offsets of said 
additional frames relative to said designated 
frame; 

said means for digitally parametizing said 
monitored signal is operative to form a string of 
monitored digital words each representing a 
frame (10) thereof; and 

said searching means is operative to 
search said library for a signature for which a 
monitored digital word represents said designat- 
ed frame (10) and to compare the additional 
words of any such signature with the words of 
said parametized monitored signal at said offsets 
relative to said monitored digital word. 

21. The apparatus of either of claims 19 or or 20 
wherein said constructing means operates on a 
video portion of said segment. 

22. The apparatus of either of claims 1 9 or 20 where- 
in said constructing means operates on both au- 
dio and video portions of said segment. 

23. The apparatus of any of claims 19 to 22 wherein 
each of said segments includes a constant por- 
tion and a variable portion; and where said signa- 
ture is constructed from a known sample of the 
constant portion of such a segment to be recog- 
nized; said apparatus further comprising: 

means (82, 83) for recording additional 
data from known samples of said variable por- 
tion; 

means (81) for storing said additional data 
with said signature; 

means (26) for associating with said stor- 
ed signature an indication of the existence of said 
variable portion; and 

means (82) for using said additional data 
to identify the variable portion of a broadcast seg- 



ment once the constant portion has been identi- 
fied. 

24. The apparatus of Claim 23 wherein: 

5 said recording means comprises means 

(82) for constructing a second signature for said 
variable portion; and 

said using means comprises means (82) 
for identifying the variable portion of said broad- 
10 cast segment with said second signature. 

25. The apparatus of Claim 23 wherein: 

said recording means comprises means 

(83) for recording at least one video frame of said 
15 variable portion; and 

said using means comprises means for 
performing a direct comparison of said at least 
one video frame and at least one frame of said 
monitored broadcast signal. 

20 

26. The apparatus of any claims 19 to 25 further 
comprising: 

means for detecting, in said monitored sig- 
nal, the occurrence of artifacts characteristic of 
25 potential unknown segments to be recognized; 

and 

means for classifying and identifying said 
potential unknown segments. 

30 27. A system for continuous pattern recognition of 
broadcast segments, incorporating apparatus as 
claimed in claim 26 and comprising: 

a communications network (23a, 23b, 29) 
linking a central site (22) and a plurality of local 

35 sites (21) located in different geographic regions 

for monitoring broadcast signals in said regions; 

each of said local sites (21 ) has at least 
said storing means, said digitally parametizing 
means, said searching means, and said detecting 

40 means, said storing means containing a local li- 

brary of segment signatures applicable to broad- 
cast signals in its geographic region; 

said central site (22) has said constructing 
means and storing means containing a global ii- 

45 brary containing all of the information in all of said 

local libraries; and 

said classifying and identifying means 
comprises: 

means at each of said local sites (21) for 

so generating compressed audio and video informa- 

tion, a temporary digital signature, and parame- 
tized monitored signal information for a potential 
unknown segment not found in the respective lo- 
cal library and for transmitting at least said para- 

55 metized monitored signal information and said 

temporary digital signature for a potential un- 
known segment via said communications net- 
work to said central site (22); 
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. means (25) at said central site for search- 
ing and comparing signatures stored in said glo- 
bal library with said transmitted parametized 
monitored signal information; 

means (25) at said central site (22) for s 
grouping together like potential unknown seg- 
ments received by said central site (22) from said 
local sites (21) and not found in said global libra- 
ry; 

means (27) at said central site (22) for re- 10 
questing at least one of said compressed audio 
and video information for at least one of said 
grouped potential unknown segments and for al- 
lowing an operator to play back said at least one 
of said audio and video information to classify 15 
said segment and to instruct said constructing 
means (25) to automatically construct a signa- 
ture for said segment; and 

means for adding said signature con- 
structed by said constructing means at said cen- 20 
tral site (22) to said global library and for trans- 
mitting it via said communications network (23a, 
23b, 29) to said local libraries. 

28. The system of claim 27 wherein said grouping 25 
means comprises: 

means (25) for comparing the temporary 
digital signatures of other potential unknown seg- 
ments to a parametized potential unknown seg- 
ment; 30 

for all potential unknown segments match- 
ing a given temporary digital signature, means for 
temporally aligning the parametized monitored 
signal information of said segments; and 

means for constructing a best fit to said 35 
aligned parametized monitored signal informa- 
tion. 



29. The system of either of claims 27 or 28, further 
comprising means for transmitting from each of 
said local sites (21) to said central site (22) infor- 
mation concerning the occurrence of broadcast 
segments and means at said central site (22) for 
logging said information. 
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30. The system of claim 29 further comprising means 
at said local site (21) for storing the temporary 
digital signature of a potential unknown segment 
and for logging the occurrences of said potential 
unknown segment based on said stored tempor- 50 
ary signature as log information, and means for 
transmitting said log information to said central 
site (22) after said central site (22) has identified 
said potential unknown segment. 

55 



Patentanspruche 

1. Verfahren zur kontinuierlichen Mustererkennung 
von Sendesegmenten, wobei das Verfahren auf- 
weist: 

Aufbau einer digitals n Signaturaus einer be- 
kannten Probe eines zu erkennenden Segmentes 
durch digitales Parametrisieren des Segmentes, 
Auswahien von Teilen (1 1 bis 1 16 ) von statistischen 
Bildpositionen aus dem parametrisierten Segment 
in Ubereinstimmung mit einem Satz vordef inierter 
Regeln zur Bildung der Signatur und Zuordnen, 
zur Signatur, der Bildpositionen der Teile relativ 
zu einer Bezugsposition, 

Speichern der Signatur und der zugeord- 
neten Bi Id posit ionsinformation in einer Signatur- 
bibliothek, wobei jede Signatur in der Bibliothek 
mit einem speziellen zu erkennenden Segment 
identif iziert ist, 

Uberwachen eines Sendesignales, 

digitales Parametrisieren des Oberwach- 
ten Signals auf bildweiser Basis, 

fur jedes Bild (10) des parametrisierten, 
Oberwachten Signals, Durchsuchen der Biblio- 
thek nach einer zu potentiell zugeordneten Si- 
gnatur unter Verwendung der Bildpositionsinfor- 
mation, die mit der potentiell zugeordneten Si- 
gnatur verbunden ist, Vergleichen der potentiell 
zugeordneten Signatur mit den geeigneten Bil- 
dern (10) des parametrisierten, Oberwachten Si- 
gnals. 

2. Verfahren nach Anspruch 1 , wobei: 

der Schritt des Aufbaus einer digitalen Si- 
gnatur aus einer bekannten Probe eines zu erken- 
nenden Segments das digitale Parametrisieren des 
Segmentes durch Bildung einer Folge von digitalen 
Worten umfa&t, von denen jedes einem Bild des 
Segments entspricht, die Identifizierung eines 
Wortes, das ein bezeichnetes Bild in diesem Seg- 
ment angibt, wobei die Zuordnung zum Segment 
des Wortes, das das bezeichnete Bild angibt, 
nichtexklusiv ist, die Identifizierung des Offsets 
der Bildpositionen relativ zu dem bezeichneten 
Bild und das Auswahien einer Anza hi von zusatz- 
lichen Wortern, von denen jedes jeweils eins der 
Bilder in den Bildpositionen angibt, 

wobei der Schritt des Speicherns der Si- 
gnatur und der Bildpositionsinformation das 
Speichern des Wortes umfaRt, das das bezeich- 
nete Bild angibt, und der Vielzahl von zusatzli- 
chen Wortern zusammen mit Information, die die 
Offsets der Bildpositionen relativ zu dem be- 
zeichneten Bild angibt, 

wobei der Schritt des digitalen Parametri- 
sierens des Oberwachten Signals das Ausbilden ei- 
ner Vielzahl von Oberwachten DigitalwSrtern um- 
fa&t von denen jedes ein Bild des Oberwachten 
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Signals angibt und 

wobei fur jedes Bild des parametrisierten 
uberwach- ten Signals der Schritt des Durchsu- 
chens der Bibllothek das Durchsuchen der Biblio- 
thek nach jeder Signatur umfaBt fur die das uber- 5 
wachte Digitalwort das das Bild angibt, ebenfalls 
das bezeichnete Bild angibt und das Vergleichen 
der zusatzlichen Worter jeder derartigen Signatur 
mit den Wortern des parametrisierten uberwachten 
Signals mit Offsets relativ zu dem uberwachten 10 
Digitalwort. 

3. Verfahren nach einem der Anspruche 1 oder 2, 
wobei die Signatur und das parametrisierte uber- 
wachte Signal aus Videoanteilen des Segments 15 
und des uberwachten Signals abgeleitet werden. 

4. Verfahren nach Anspruch 1 oder 2, wobei die Si- 
gnatur und das parametrisierte uberwachte Si- 
gnal von sowohl Audioals auch Videoteilen des 20 
Segmentes und des uberwachten Signals abge- 
leitet werden. 



Biides ist 

11. Verfahren nach einem der Anspruche 6 oder 7, 
wobei der zumindest eine Bezugsbereich fur je- 
den der ausgewahlten Bereiche (1, bis 1 16 ) ein 
unterschiedlicher vorausgewahlter Bereich (1' t 
bis 1' 16 ) eines vorhergehenden Biides (10) ist 

12. Verfahren nach Anspruch 4, wobei die Signatur 
und das parametrisierte uberwachte Signal zu- 
mindest teilweise aus einen Frequenzspektrum 
des Audioanteils abgeleitet werden. 

13. Verfahren nach Anspruch 12, wobei die Signatur 
und das parametrisierte uberwachte Signal je- 
weils einer Anzahl von Digitalwortern aufweisen, 
wobei jedes Digitalwort der Signatur und des 
parametrisierten uberwachten Signals durch 
Vergleich ausgewahlter Frequenzbander des Au- 
dioanteils mit zumindest einem Bezugsband ab- 
geleitet werden, wobei jedes der ausgewahlten 
Bander ein Bit des Digital wortes liefert 



5. Verfahren nach Anspruch 3, wobei die Signatur 

und das parametrisierte uberwachte Signal aus 25 
Lumineszenzwerten des Videoanteils abgeleitet 
werden. 

6. Verfahren nach Anspruch 5, wobei die Signatur 
und das parametrisierte uberwachte Signal 
durch Vergleich von Mittelwertlumineszenzen 
ausgewahlter Bereiche (1i bis 1 16 ) eines Biides 
(10) des Segmentes bzw. des uberwachten Si- 
gnals mit einer gemittelten Lumineszenz von zu- 
mindest einem Bezugsbereich abgeleitet wer- 
den, wobei jeder der ausgewahl- ten Bereiche (1 ■) 
bis 1 16 ) ein Bit einer entsprechenden der Signa- 
turen und des paramentrisierten uberwachten 
Signals liefert. 

7. Verfahren nach Anspruch 6, wobei die ausge- 
wahlten Bereiche (1i bis 1 16 ) asym met risen von 
der Mitte des Biides (10) beabstandet sind. 

8. Verfahren nach einem der Anspruche 6 oder 7, 45 
wobei derzumindest eine Bezugsbereich das ge- 
samte Bild (10) ist. 

9. Verfahen nach einem der Anspruche 6 oder 7, 
wobei der zumindest eine Bezugsbereich fur je- so 
den der ausgewahlten Bereiche (1, bis 1 16 ) ein 
unterschiedlicher vorausgewahlter Bereich des 
Biides (10) ist 

10. Verfahren nach einem der Anspruche 6 oder 7, 55 
wobei der zumindest eine Bezugsbereich fur je- 

den der ausgewahlten Bereiche (1, bis 1 16 ) der 
entsprechende Bereich eines vorhergehenden 



14. Verfahren nach einem der vorstehenden Anspru- 
che mit ferner der Reduktion des Datenanteils, 
an dem der Suchschritt durchgefuhrt wird, durch 
Auswaht von weniger als alien Daten der gespei- 
cherten Signaturen, die zu durchsuchen sind. 



1 6. Verfahren nach einem der vorstehenden Anspru- 
che, wobei jedes der Segmente einen Konstan- 
tanteil und einen variablen Anteil aufweist und 
wobei die Signatur aus einer bekannten Probe 
des Konstantanteils eines solchen zu erkennen- 
den Segments aufgebaut ist, wobei das Verfah- 
ren ferner aufweist 

Aufzeichnen von zusatzlichen Daten aus 
bekannten Proben des variablen Anteils, 

Speichern der zusatzlichen Daten mit der 
Signatur, 

Zuordnen einer Anzeige der Anwesenheit 
des variablen Anteils zu der gespeicherten Si- 



30 1 5. Verfahren nach Anspruch 14, wobei der Datenre- 
duktionsschritt die Zuordnung eines Digital wor- 
tes umfa&t, das ein gewunschtes Bild des Seg- 
ments mit der Signatur des Segments angibt wo- 
bei die Zuordnung nichtexklusiv ist der Schritt des 
35 digitalen Parametrisierens des uberwachten Si- 

gnals die Ausbildung einer Anzahl von Digitalwor- 
tern umfa&t die jeweils ein Bild des uberwachten 
Signals angeben, und wobei der Suchschritt fur je- 
des Digitalwort in dem parametrisierten uberwach- 
40 ten Signal das Durchsuchen der Bibliothek nach al- 

ien gespeicherten Signaturen umfa&t fur die das 
Digitalwort in dem parametrisierten uberwachten 
Signal mit dem Digitalwort, das das bezeichnete 
Bild angibt, ubereinstimmt 
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gnatur, 

Verwenden der zusatzlichen Daten zur 
Identifizierung des variablen Anteils eines Sen- 
desegments, sobald der Konstantanteil identif i- 
ziert wurde. 5 

17. Verfahren nach Anspruch 16, wobei: 

der Schritt des Aufzeichnens der zusatzli- 
chen Daten den Aufbau einer zweiten Signatur 
fur den variablen Anteil umfa&t und 10 

der Verwendungsschritt die Identifizie- 
rung des variablen Anteils des Sendesegments 
mit der zweiten Signatur umfaRt. 

18. Verfahren nach Anspruch 16, wobei: 15 

der Schritt des Aufzeichnens der zusatzli- 
chen Daten das Aufzeichnen von zumindest ei- 
nem Videobild des variablen Anteils umfaBt 

und der Verwendungsschritt die Durchfuh- 
rung eines Direktvergleiches des zumindest ei- 20 
nen Videobiides und zumindest eines Bifdes des 
uberwachten ausgesandten Signals aufweist. 

19. Einrichtung zur kontinuierlichen Mustererken- 
nung von Sendersegmenten, wobei die Einrich- 25 
tung aufweist: 

eine Einrichtung zum Aufbau einer digita- 
len Signatur aus einer bekannten Probe des 
zu erkennenden Segmentes durch digitales 
Parametrisieren des Segmentes, Auswahl von 30 
Teilen bis 1 16 ) aus statistischen Bildpositio- 
nen im ganzen parametrisierten Segment in 
Ubereinstimmung mit einem Satz vordefinierter 
Regeln zur Bildung der Signatur und Zuordnen 
der Signatur die Bildpositionen der Teile relativ 35 
zu einer Bezugsposition, 

einer Einrichtung zum Speichern einer Bi- 
bliothek von Signaturen und zugeordneten Bild- 
positionsinformationen, wobei jede Signatur in 
der Bibliothek mit einem speziellen zu erkennen- 40 
den Segment identif iziert ist, 

einer Einrichtung zur Oberwachung eines 
Sendesignals, 

einer Einrichtung zum digitalen Parametri- 
sieren des uberwachten Signals auf bildweiser Basis 45 

und einer Einrichtung zum Durchsuchen 
der Bibliothek nach einer Signatur, die potentiell 
jedem Bild (10) des parametrisierten uberwach- 
ten Signal zugeordnet ist und, unter Verwendung 
der Bildposittonsinformation, die der potentiell zu- so 
geordneten Signatur zugeordnet ist, zum Vergleich 
der potentiell zugeordneten Signatur mit den geeig- 
neten Bildern (10) des parametrisierten uber- 
wachten Signals (20). 

55 

20. Einrichtung nach Anspruch 19, wobei: 

die Aufbaueinrichtung zum digitalen 
Parametrisieren des Segmentes durch Ausbil- 



dung einer Folge von Digitalwdrter n arbeitet, wo- 
bei jedes der Digitalwdrter ein Bild (10) des Seg- 
mentes reprasentiert, wobei die Aufbaueinrich- 
tung ferner arbeitet, um ein Wort, das ein be- 
zeichnetes Bild (10) in dem Segment reprasen- 
tiert, zu identif izieren, wobei die Zuordnung zum 
Segment des Wortes, das das bezeichnete Bild 
(10) reprasentiert, nichtexklusiv ist, und um eine 
Anzahl von zusatzlichen Wortern auswahlen, 
von denen jedes jeweils eines der Bilder (1 0) bei 
den statistischen Bildpositionen reprasentiert, 

wobei die Speichereinrichtung arbeitet, 
um in der Signaturbibliothek die Digitalwdrter zu 
speichern, die das ausgezeichnete Bild (10) und 
die zusatzlichen Bilder (10) reprasentieren, zu- 
sammen mit Offsets der zusatzlichen Bilder rela- 
tiv zum bezeichneten Bild, 

wobei die Einrichtung zum digitalen 
Parametrisieren des uberwachten Signal arbei- 
tet, um eine Folge von uberwachten Digitalwor- 
tern zu bilden, von denen jedes ein Bild (10) da- 
von angibt, und 

wobei die Sucheinrichtung arbeitet, umdie 
Bibliothek nach einer Signatur zu durchsuchen, 
fur die ein uberwachtes Digital wort das bezeich- 
nete Bild (10) reprasentiert und um die zusatzli- 
chen Worter jeder solchen Signatur mit den Wor- 
tern des parametrisierten uberwachten Signals 
bei den Offsets relativ zum uberwachten Digital- 
wort zu vergieichen. 

21. Einrichtung nach einem der Anspruche 19 Oder 
20, wobei die Aufbaueinrichtung an einem Video- 
anteil des Segmentes arbeitet. 

22. Einrichtung nach einem der Anspruche 19 oder 
20, wobei die Aufbaueinrichtung sowohl an ei- 
nem Audioanteil als auch an einem Videoanteil 
des Sements arbeitet. 

23. Einrichtung nach einem der Anspruche 1 9 bis 22, 
wobei jedes der Segmente einen Konstantanteil 
und einen variablen Anteil aufweist und wobei je- 
de Signatur aus einer bekannten Probe des Kon- 
stantanteils eines solchen zu erkennenden Seg- 
ments aufgebaut ist, wobei die Einrichtung ferner 
aufweist 

eine Einrichtung (82, 83) zum Aufzeich- 
nen von zusatzlichen Daten bekannter Proben 
des variablen Anteils, eine Einrichtung (81) zum 
Speichern der zusatzlichen Daten mit der Signa- 
tur, 

eine Einrichtung (26) zur Zuordnung einer 
Anzeige der Anwesenheit des variablen Anteils 
der gespeicherten Signatur, 

und eine Einrichtung (82) zur Verwendung 
der zusatzlichen Daten zur Identifizierung des 
variablen Anteils eines ausgesandten Sendeseg- 
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mentes, sobald der Konstantanteil identifiziert 
wurde. 

24. Einrichtung nach Anspruch 23, wobei: 

die Aufzeichnungseinrichtung eine Ein- 
richtung (82) zum Aufbau einer zweiten Signatur 
fur den variablen Anteil ausweist und 

die Verwendungseinrichtung (82) eine 
Einrichtung zur Identifizierung eines varibalen 
Anteils des Sendesegments mit der zweiten Si- 
gnatur aufweist 

25. Einrichtung nach Anspruch 23, wobei: 

die Aufzeichnungseinrichtung eine Ein- 
richtung (83) zum Auf zeichnen von zumindest ei- 
nem Videobild des variablen Anteils aufweist und 

die Verwendungseinrichtung eine Einrich- 
tung aufweist zur Durchf uhrung eines Direktver- 
gteichs des zumindest einen vldeobildes und zu- 
mindest eines Bildes des uberwachten ausge- 
sandten Signals aufweist. 

26. Einrichtung nach einem der Anspruche 19 bis 25 
mit fernen 

einer Einrichtung zur Erfassung des Auf- 
tretens von Artefakten eines potentiell unbekann- 
ten zu erkennenden Segmentes und 

einer Einrichtung zur Wassifizierung und 
Identifizierung der potentiell unbekannten Seg- 
mente. 

27. System zur kontinuierlichen Mustererkennung 
eines Sendesegments mit einer Einrichtung nach 
Anspruch 26 und mit: 

einem Kommunikationsnetzwerk (23a, 
23b, 29), das einen Zentralort (22) und eine An- 
zahl von Lokalorten (21), die in unterschiedlichen 
geographischen Regionen angeordnet sind, zur 
Uberwachung vom Sendersignalen in den Regio- 
nen verbindet, 

wobei jeder der lokalen Orte (21) zumin- 
dest die Speichereinrichtung aufweist, die Ein- 
richtung zum digitalen Parametrisiern, die Such- 
einrichtung und die Erfassung seinrichtung, wo- 
bei die Speichereinrichtung eine Lokalbibiiothek 
von Segment signature n aufweist, dief Or Sender- 
signale in ihrer geographischen Region verwend- 
barsind, 

wobei der Zentralort (22) die Aufbauein- 
richtung und die Speichereinrichtung aufweist, 
die eine globale Biblio- thek aufweist, die alle In- 
formationen in alien Lokalbibliotheken umfaBt, 
und wobei die Klassifizierung- und Identifizie- 
rungseinrichtung aufweist: 

eine Einrichtung, an jedem der lokalen Or- 
te (21), zur Erzeugung von komprimierten Audio- 
und Videoinformationen, einer temporare Digital- 
signatur und parametrisierter uberwachter Si- 
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gnalinformationen furein potentiell unbekanntes 
Segment, das nicht in der entsprechenen Lokal- 
bibiiothek aufgefunden wurde, und zur Obermitt- 
lung zumindest der parametrierten, uberwachten 

5 Signal information und der temporaren Digitals i- 

gnatur fur ein potentiell unbekanntes Segment 
uber das Kommunikationsnetzwerk an den Zen- 
tralort (22), 

eine Einrichtung (22) am Zentralort zum 

10 Suchen und Vergleichen von Signaturen, die in 

der Globalbibilothek gespeichert sind, mit der 
ubertragenen parametrisieren uberwachten Sh 
gnal information, 

eine Einrichtung (25) am Zentralort (22) 

15 zum Zusammengruppieren gleicher potentiell un- 

bekannter Segmente, die durch die Zentralorte 
(22) von den Lokalorten (21) erhalten wurden und 
nicht in der globalen Bibiliothek gefunden wur- 
den, 

20 eine Einrichtung (27) am Zentralort (22) 

zur Anforderung von zumindest einer der kompri- 
mierten Audio- und Videoinformationen fur zu- 
mindest eines der gruppierten potentiell unbe- 
kannten Segmente, so daft eine Bedienungsper- 

25 son die zumindest eine der Audio- und Videoin- 

formationen wiederzugeben kann, zur Klassifi- 
zierung des Segmentes und zum Befehlen der 
Aufbau einrichtung (25) zum automat ischen Auf- 
bau einer Signatur fur das Segment, und 

30 eine Einrichtung zum Zufugen der Signa- 

tur, die durch die Aufbaueinrichtung am Zentral- 
ort (22) aufgebaut wurde, zur Global bibliothek 
und zur Ubertragung uber das Kommunikations- 
netzwerk (23a, 23b, 29) an die Lokalbibliothe- 

35 ken. 

28. System nach Anspruch 27, wobei die Gruppie- 
rungseinrichtung aufweist: 

eine Einrichtung (25) zum Vergleich der 
40 temporaren Digitalsignaturen von anderen po- 

tentiell unbekannten Segmenten mit einem 
parametrisierten, potentiell unbekannten Seg- 
ment, 

eine Einrichtung fur alle potentiell unbe- 
45 kannte Segmente, die einer gegebenen tempora- 

ren Digitalsignatur entsprechen zum temporaren 
Ausrichten der parametrisierten, uberwachten 
Signalinformtion des Segmentes, und 

eine Einrichtung zum Aufbau einer besten 
50 An passu ng an die ausgerichtete parametrisierte 

uberwachte Signalinformation. 

29. System nach einem der Anspruche 27 Oder 28 mit 
ferner einer Einrichtung zur Ubertragung von In- 

55 formationen betreffend das Auftreten von Sen- 

dersegmenten von jedem der lokalen Orte (21) 
an den Zentralort (22) und einer Einrichtung am 
Zentralort (22) zum Speichern der Informationen. 
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30. System nach Anspruch 29, mit ferner einer Ein- 
richtung an dem Lokalort (21 ) zum Speichern der 
temporaren Digitalsignatur eines potentiell unbe- 
kannten Segmentes und zum Speichern des Auf- 
tretens des potentiell unbekannten Segmentes s 
aufgrund der gespeicherten Temporarsignatur 
als Speicherinformation, und eine Einrichtung 
zum Obertragen der Speicherinformtion an den 
Zentralort (22) nachdem der Zentralort (22) das 
potentiell unbekannte Segment identifiziert hat 10 



Revendications 

1. Precede pour la reconnaissance continue de mo- is 
deles de segments telediffuses, (edit procede 
comportant : 

la construction d'une signature numerique 
a partir d'un echantillon connu d'un segment de- 
vant dtre reconnu par parametrage numerique 20 
dudit segment, la selection de parties (1i a 1 16 ) 
parmi des emplacements de trame aleatoires 
dans ledit segment parametre en fonction d'un 
ensemble de regies predefinies de fagon a for- 
mer ladite signature, et I'association a ladite si- 25 
g nature des emplacements de trame desdites 
parties par rapport a un emplacement de referen- 
ce; ........ 

le stockage de ladite signature et de r infor- 
mation d'emplacement de trame associee dans 30 
une bibliotheque de signatures, chaque signatu- 
re dans ladite bibliotheque etant identif iee a un 
segment particulier devant §tre reconnu; 

le contrdle d'un signal telediffuse; 

le parametrage numerique dudit signal 35 
contrdle sur une base trame par trame; 

pour chaque trame (10) dudit signal 
contrdle parametre, la recherche de ladite bi- 
bliotheque pour une signature potentiellement 
associee et, en utilisant rinfonmation d'emplace- 40 
ment de trame associee a ladite signature poten- 
tiellement associee, la comparaison de ladite si- 
gnature potentiellement associee a des trames 
(10) appropriees dudit signal contrdle parametre. 

45 

2. Procede selon la revendication 1, selon lequel : 

I'etape de construction d'une signature 
numerique a partir d'un echantillon connu d'un 
segment devant etre reconnu comprend le para- 
metrage numerique dudit segment en formant so 
une chatne de mots numeriques representant 
chacun une trame dudit segment, I'identif ication 
d'un mot representant une trame designee dans 
ledit segment, ('association avec ledit segment 
du mot representant ladite trame designee 55 
n'etant pas exclusive, I'identif ication des decala- 
ges desdits emplacements de trame par rapport 
a ladite trame designee, et la selection de plu- 



sieurs mots additionnels representant chacun 
une trame respective des trames au niveau des- 
dits emplacements de trame; 

I'etape de stockage de ladite signature et 
de I'information d'emplacement de trame 
comprend le stockage du mot representant ladite 
trame designee et de ladite multiplicity de mots 
additionnels avec I'information representant ies 
decalages desdits emplacements de trame par 
rapport a ladite trame designee; 

I'etape de parametrage numerique dudit 
signal contrdle comporte la formation d'une plu- 
ral ite de mots numeriques contrdles representant 
chacun une trame dudit signal contrdle; et 

pour chaque trame dudit signal contrdle 
parametre, I'etape de recherche de ladite bi- 
bliotheque comprend la recherche de ladite bi- 
bliotheque pour une signature quelconque pour 
laquelle le mot numerique contrdle representant 
ladite trame represents egalement ladite trame 
designee, et la comparaison des mots addition- 
nels d'une signature quelconque avec Ies mots 
dudit signal contrdle parametre pour lesdits de- 
calages par rapport audit mot numerique contrd- 
le. - 

3. Procede selon la revendication 1 ou 2, selon le-A 
quel ladite signature et le signal contrdle para me- - 
tre sont obtenus a partir de parties video dudit 
segment et dudit signal contrdle. 

4. Proced6 selon la revendication 1 ou 2, selon le-: 
quel ladite signature et le signal contrdle parame- - 
tre sont obtenus a partir a la fois de parties audio, 
et video dudit segment et dudit signal contrdle. 

5. Procede selon la revendication 3, selon lequel la- 
dite signature et ledit signal contrdle parametre 
sont obtenus a partir des valeurs de luminance de 
ladite partie video. 

6. Procede selon la revendication 5, selon lequel la- 
dite signature et ledit signal contrdle parametre 
sont obtenus en comparant des luminances 
moyennes de zones choisies (1-i a 1 16 ) d'une tra- 
me (10) dudit segment et du signal contrdle res- 
pectivement a une luminance moyenne d'au 
moins une zone de reference, chacune desdites 
zones choisies (1 ^ a 1 16 ) procurant un bit de ladite 
signature ou dudit signal contrdle parametre res- 
pectif. 

7. Procede selon la revendication 6, selon lequel 
lesdites zones choisies (^ a 1 16 ) sont espacees 
de manrere asymetrique autour du centre de la- 
dite trame (10). 

8. Procede selon la revendication 6 ou 7, selon le- 
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quel au moins ladite zone de reference est ladite 
trame (10) complete. 

9. Precede selon la revendication 6 ou 7, selon le- 
quel au moins ladite zone de reference est, pour 
chacune desdites zones choisies (1 t a 1 16 ), une 
zone pr6determinee diffeYente de ladite trame 
(10). 

10. Precede selon la revendication 6 ou 7, selon le- 
quel au moins ladite zone de reference est, pour 
chacune desdites zones choisies (1! a 1 16 ), la 
zone correspondante d'une trame prec6dente. 

11. Precede selon la revendication 6 ou 7, selon le- 
quel au moins ladite zone de reference est, pour 
chacune desdites zones choisies (1, a 1 16 ), une 
zone predeterminee differente (1'j a 1' 18 ) d'une 
trame (10) precedente. 

12. Procede selon la revendication 4, selon lequel la- 
dite signature et ledit signal controle parametr6 
sont obtenus au moins en partie a partir d'un 
spectre de frequence de ladite partie audio. 
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13. Procede selon la revendication 12, selon lequel 
ladite signature et ledit signal controle parametre 
comportent chacun plusieurs mots numeriques, 
chaque mot numerique de ladite signature et du- 

dit signal controle parametre 6tant obtenu en 30 
comparant des bandes de frequences choisies 
de ladite partie audio a au moins une bande de 
reference, chacune desdites bandes choisies 
procurant un bit dudit mot numerique. 

35 

14. Proced6 selon Tune quelconque des revendica- 
tions prec£dentes, comportant, en outre, la re- 
duction de la quantite de donnees sur lesquelles 
ladite etape de recherche est realisee en choisis- 
sant moins de la total ite des donnees des signa- 40 
tures stockees devant etre recherchees. 

15. Procede selon la revendication 14, selon lequel 
ladite etape de reduction de donnees comporte 
('association d'un mot numerique representant 45 
une trame designee dudit segment et de la signa- 
ture dudit segment, ladite association n'etant pas 
exclusive, I'etape de parametrage numerique du- 
dit signal contrdl6 comporte la formation de plu- 
sieurs mots numeriques representant chacun so 
une trame dudit signal contrdle, et ladite etape de 
recherche comporte, pour chaque mot numeri- 
que dans ledit signal contrdle parametre, la re- 
cherche de ladite bibliotheque pour une signature 
stockee quelconque pour laquelle ledit mot nu- 55 
merique dans ledit signal contrdle parametre 
correspond audit mot numerique representant la- 
dite trame designee. 



16. Procede selon Tune quelconque des revendica- 
tions precedentes, selon lequel chacun desdits 
segments comprend une partie constante etune 
partie variable; et ou ladite signature est cons- 
truite a partir d'un echantillon connu de la partie 
constante d'un tel segment devant etre reconnu; 
ledit procede comportant en outre : 

I'enregistrement de donnees additionnef- 
les a partir des echantillons connus de ladite par- 
tie variable; 

le stockage desdites donnees additionnel- 
les avec ladite signature; 

I'association a ladite signature stockee 
d'une indication de ('existence de ladite partie va- 
riable; 

('utilisation desdites donnees additionnel- 
les afin d'identifier la partie variable d'un seg- 
ment telediff us6 une fois que la partie constante 
a ete identif iee. 

17. Procede selon la revendication 16, selon lequel : 

ladite etape d'enregistrement de donnees 
additionnelles comporte la construction d'une 
deuxieme signature pour ladite partie variable; et 

ladite etape d'utilisation comporte ('identi- 
fication de la partie variable dudit segment tele- 
diffuse avec ladite deuxieme signature. 

18. Procede selon la revendication 16, selon lequel : 

ladite 6tape d'enregistrement de donn6es 
additionnelles comporte I'enregistrement d'au 
moins une trame video de ladite partie variable; 
et 

ladite etape d'utilisation comporte la reali- 
sation d'une comparison directe d'au moins la- 
dite trame video et d'au moins une trame dudit si- 
gnal telediffuse contrdle. 

19. Appareil pour la reconnaissance continue de mo- 
deles de segments telediffus6s, ledit appareil 
comportant : 

des moyens pour la construction d'une si- 
gnature numerique a partir d'un echantillon 
connu d'un segment devant etre reconnu par pa- 
rametrage numerique dudit segment, la selection 
de parties a 1 16 ) parmi des emplacements de 
trame a! ea to ires dans ledit segment parametre 
en fonction d'un ensemble de regies predefines 
de fagon a former ladite signature, et I'associa- 
tion a ladite signature des emplacements de tra- 
me desdites parties par rapport a un emplace- 
ment de reference; 

des moyens pour le stockage d'une bi- 
bliotheque de signatures etde ('information d'em- 
placement de trame associee, chaque signature 
dans ladite bibliotheque 6tant identif iee a un seg- 
ment particulier devant dtre reconnu; 

des moyens pour le contrdle d'un signal te- 
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lediffuse; 

des moyens pour le parametrage numeri- 
que dudit signal contrdle sur une base trame par 
trame; et 

des moyens pour la recherche de ladite bi- 
bliotheque pour une signature potentiellement 
associee a chaque trame (1 0) dudit signal contro- 
ls parametre et, en utilisant reformation d'em- 
placement de trame associee a ladite signature 
potentiellement associee, pour la comparaison 
de ladite signature potentiellement associee a 
destrames (10) appropriees dudit signal contrdle 
parametre. 

20. Appareil selon la revendication 19, dans lequel : 

lesdits moyens de construction sont ope- 
rationnels af in de parametrer de maniere nume- 
rique ledit segment en formant une chatne de 
mots numeriques, chacun desdits mots repre- 
sentant une trame (10) dudit segment, lesdits 
moyens de construction etant, en outre, opera- 
tionnels pour I'identification d'un mot represen- 
tant une trame designee (1 0) dans ledit segment, 
('association avec ledit segment du mot represen- 
tant ladite trame designee (10) n'etant pas exclu- 
sive, et la selection de plusieurs mots addition- 
nels representant chacun une trame respective 
des trames (10) au niveau desdits emplace- 
ments de trame aleatoires; 

lesdits moyens de stockage etant opera- 
tionnels af in de stocker dans ladite bibliotheque 
de signatures les mots numeriques representant 
ladite trame designee (10) et lesdites trames ad- 
ditionnelles (10) avec des decalages desdites 
trames additionnelles par rapport a ladite trame 
designee; 

lesdits moyens de parametrage numeri- 
que dudit signal contrdle etant operationnels af in 
de former une chatne de mots numeriques 
contrdles representant chacun une trame (10) de 
celui-ci; et 

lesdits moyens de recherche de ladite bi- 
bliotheque etant operationnels af in de rechercher 
ladite bibliotheque pour une signature pour la- 
quelle un mot numerique contrdle represente la- 
dite trame designee (10) et comparer les mots 
additionnels d'une signature quelconque avec 
les mots dudit signal contrdle parametre pour les- 
dits decalages par rapport audit mot numerique 
contrdle. 

21. Appareil selon la revendication 19 ou 20, dans le- 
quel lesdits moyens de construction agissentsur 
une partie video dudit segment. 

22. Appareil selon la revendication 19 ou 20, dans le- 
quel lesdits moyens de construction agissent sur 
les deux parties audio et video dudit segment. 



23. Appareil selon Tune quelconque des revendica- 
tions 19 a 22, dans lequel chacun desdits seg- 
ments comprend une partie constante et une par- 
tie variable; et ou ladite signature est construite 

5 a partir d'un echantillon connu de la partie cons- 

tante d'un tel segment devant etre reconnu; ledit 
appareil comportant en outre : 

des moyens (82, 83) pourl'enregistrement 
de donnees additionnelles a partir des echantil- 
10 . Ions conn us de ladite partie variable; 

des moyens (81) pour le stockage desdi- 
tes donnees additionnelles avec ladite signature; 

des moyens (26) pour ('association a ladite 
signature stockee d'une indication de I 'existence 
15 de ladite partie variable; et 

des moyens (82) pourl'utilisation desdites 
donnees additionnelles af in d'identif ier la partie 
variable d'un segment telediffuse une fois que la 
partie constante a ete identif iee. 

20 

24. Appareil selon la revendication 23, dans lequel : 

lesdits moyens d'enregistrement compor- 
tent des moyens (82) pour la construction d'une 
deuxieme signature pour ladite partie variable; et 
25 lesdits moyens d'utilisation comportent 

des moyens (82) pour I'identification de la partie 
variable dudit segment telediffuse avec ladite 
deuxieme signature. 

30 25. Appareil selon la revendication 23, dans lequel : 
lesdits moyens d'enregistrement compor- 
tent des moyens (83) pour I'enregistrement d'au 
moins une trame video de ladite partie variable; 
et 

35 lesdits moyens d'utilisation comportent 

des moyens destines a realiser une comparaison 
directe d'au moins ladite trame video et d'au 
moins une trame dudit signal telediffuse contrd- 
le. 

40 

26. Appareil selon I'une quelconque des revendica- 
tions 19 a 25, comportant en outre : 

des moyens destines a detector, dans ledit 
signal contrdle, I'apparition d'artefacts caracte- 
45 ristiques de segments inconnus potentiels de- 

vant etre reconnus; et 

des moyens destines a classer et identi- 
fier lesdits segments inconnus potentiels. 

50 27. Systeme pour la reconnaissance continue de 
modeles de segments telediffuses, incorporant 
Tappareil selon la revendication 26, et compor- 
tant: 

un rosea u de communication (23a, 23b, 
55 29) reliant un site central (22) et plusieurs sites lo- 

caux (21) situ es dans d if fe rentes regions geogra- 
phiques af in de contrdler des signaux telediffu- 
ses dans lesdites regions; 
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chacun desdits sites locaux (21) possede 
au moins lesdits moyens de stockage, lesdits 
moyens de parametrage numerique, lesdits 
moyens de recherche, et lesdits moyens de de- 
tection, lesdits moyens de stockage contenant 
une bibliotheque locale de signatures de seg- 
ment applicables aux signaux telediffuses dans 
sa region geographique; 

I edit site central (22) possede lesdits 
moyens de construction et moyens de stockage 
contenant une bibliotheque globale contenant 
toute I' information dans toutes lesdites bibliothe- 
ques locales; et 

lesdits moyens de classification et d'iden- 
tification com portent : 

des moyens au niveau de chacun des sites 
locaux (21) destines a generer de rinfonmation 
audio et video comprimee, une signature nume- 
rique temporaire, et une information de signal 
contrdle parametre pour un segment inconnu po- 
tentiel qui ne se trouve pas dans la bibliotheque 
locale respective et destines a transmettre jus- 
qu 'audit site central (22) et au moyen dud it re- 
seau de communication au moins ladite informa- 
tion de signal contrdle parametre et ladite signa- 
ture numerique temporaire pour un segment in- 
connu potentiel; 

des moyens (25) au niveau dudit site cen- 
tral pour la recherche et la comparaison de signa- 
tures stockees dans ladite bibliotheque globale 
avec ladite information de signal contrdle para- 
metre transmise; 

des moyens (25) au niveau dudit site cen- 
tral (22) destines a regrouper des segments in- 
con n us potentiels equivalents recus par ledit site 
central (22) en provenance desdits sites locaux 
(21) et qui ne se trouvent pas dans ladite bi- 
bliotheque globale; 

des moyens (27) au niveau dudit site cen- 
tral (22) destines a demander une au moins de la- 
dite information audio ou video comprimee pour 
au moins un desdits segments inconnus poten- 
tiels regroupes et destines a permettre a un ope- 
rateurde retire au moins une de ladite information 
audio ou video af in de classer ledit segment et 
demander auxdits moyens de construction (25) 
de construire automatiquement une signature 
pour ledit segment; et 

des moyens destines a ajouter ladite si- 
gnature construite par lesdits moyens de cons- 
truction au niveau dudit site central (22) dans la- 
dite bibliotheque globale et destines a la trans- 
mettre aux dites bibliotheques locales par I'inter- 
mediaire dudit reseau de communication (23a, 
23b. 29). 
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des moyens (25) destines a comparer les 
signatures numeriques temporaires d'autres 
segments inconnus potentiels a un segment in- 
connu potentiel parametre; 

pour tous les segments inconnus poten- 
tiels correspondant a une signature numerique 
temporaire don nee, des moyens destines a ali- 
gner temporairement ('information de signal 
contrdle parametre desdits segments; et 

des moyens destines a construire une 
concordance de ladite information de signal 
contrdle parametre alignee. 

29. Systeme selon la revendication 27 ou 28, 
comportant, en outre, des moyens destines a 
transmettre de chacun desdits sites locaux (21) 
vers ledit site central (22) de I'information concer- 
nant I'apparition de segments telediffuses et des 
moyens au niveau dudit site central (22) destines 
a enregistrer ladite information. 

30. Systeme selon la revendication 29, comportant, 
en outre, des moyens au niveau dudit site local 

(21) destines a stocker la signature numerique 
temporaire d'un segment inconnu potentiel et 
destines a enregistrer les apparitions dudit seg- 
ment inconnu potentiel sur la base de ladite si- 
gnature temporaire stockee sous forme d* infor- 
mation enregistree, et des moyens destines a 
transmettre ladite information enregistree vers 
ledit site central (22) une fois que ledit site central 

(22) a identifie ledit segment inconnu potentiel. 



28. Systeme selon la revendication 27, dans lequel 
lesdits moyens de regroupement comportent : 
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